Hey fellow Lemmings,
I’m thrilled to announce the launch of AI News Summary Bot, a project that brings you News summary! The bot is now live on our community at !news_summary@lemmy.dbzer0.com.
The bot is still in its early stages, and I’m excited to hear your feedback and suggestions on how to improve it. Feel free to share your thoughts and ideas.
Repository: If you’re interested in contributing or exploring the code behind the bot, you can find the repository at https://github.com/muntedcrocodile/ai_news_bot.
Donations: If you’re interested in donating to allow me to spend more time developing please do: monero:8916FjDhEqXJqX9Koec9WaZ4QBQAa6sgW6XhQhXSjYWpQiWB42GsggEh73YAFGF86GU2gEE1TTRdWSspuMgpWGkiPHkgBTX
Stay informed, and let’s build this community together!
The model is Falconsai/text_summarization
Hugging face is first and formost a model repo not a hosting provider. Im running the model locally (its very lightwright hence no rate limmit issues).
Its a model with the sole purpose of summarisation its not a gpt model so generation has far less issues that are responsible for most hulucination issues seen.
It’s less that it’s going to hallucinate (even though it can reasonably do that) it’s that these sort of summaries don’t actually condense the most salient areas of the post, but the most statistically relevant.
Anyway if run it locally, you can consider using something like Aphrodite to more efficiently use your compute. Also consider crossposting to !lemmy_integrations@lemmy.dbzer0.com
Yeah these sorts of summaries get pretty weird. It’s hard to really grasp why they are flawed without looking at a topic you are knowledgeable about and finding something doing a summary. but for these, it can be easier to just read the article, try summarizing it yourself for another human, and then reading the ai summary. They are rarely good, and complacency is dangerous.