Support for Mozilla LLAM file (llamafile) as GPT

Talk about miscellaneous stuff that doesn't fit anywhere else. Off-topic discussions encouraged.
Post Reply
erika
Posts: 142
Joined: Thu Nov 04, 2004 5:59 pm

Support for Mozilla LLAM file (llamafile) as GPT

Post by erika »

For sensitive organizations using public ChatGPT will not be acceptable. You need to provide Open Source and Local LLAM to provide the GPT capability in Office applications.

Can you please make Softmaker Office, Free Office, and your other FlexiDPF products etc. as well to work with Mozilla Open Source LLAM file as alternative to ChatGPT as an option during setup? So users can use local GPT or an online GPT whatever they like.

Local GPT is a must for many organizations due to privacy and regulations. Many organizations cannot use any cloud GPT at all.

Mozilla open source llamafile lets you distribute and run LLMs with a single file in any OS.

https://github.com/Mozilla-Ocho/llamafile
SuperTech
SoftMaker Team
SoftMaker Team
Posts: 3408
Joined: Wed Mar 11, 2020 5:31 pm

Re: Support for Mozilla LLAM file (llamafile) as GPT

Post by SuperTech »

I have forwarded the improvement suggestion…
erika
Posts: 142
Joined: Thu Nov 04, 2004 5:59 pm

Re: Support for Mozilla LLAM file (llamafile) as GPT

Post by erika »

Additionally, Claude and Perplexity should be other public GPT options as well in your Office suite and other products.

http://claude.ai

https://perplexity.ai


So in total, you should provide 4 options: (user should be able to select which ever fits to their security and privacy requirements)


Local LLM (Mozilla)

Public ChatGpt

Public Claude

Public Perplexity
sergiuvolda
Posts: 10
Joined: Sun Oct 06, 2024 12:12 pm

Re: Support for Mozilla LLAM file (llamafile) as GPT

Post by sergiuvolda »

erika wrote: Thu Jun 20, 2024 12:11 pm For sensitive organizations using public ChatGPT will not be acceptable. You need to provide Open Source and Local LLAM to provide the GPT capability in Office applications.
In terms of privacy, I believe that SoftMaker Office is GDPR compliant. There is little to worry about. However, the "bring your own AI model" approach is interesting to consider, at least for SoftMaker Office NX and Professional.
Fedora Linux Workstation 41. Former Manjaro and Ubuntu user.
Post Reply

Return to “Water Cooler”