Do we need another GenAI solution? How & why we developed a full-stack GenAI LLM+RAG tool called Alan. A sneak peek at what I am currently working on.
An overview of the motivations and technical aspects behind developing our own GenAI solution, Alan, at Comma Soft AG.
TL;DR ⏱️
- Diverse GenAI solutions exist
- Unique motivations for developing our own tool
- Technical advantages of our solution
- Questions on custom development vs. wrappers
Current Landscape: 🏞️
- There are a variety of GenAI solutions out there
- Many models from big tech companies work increasingly well for certain use cases.
- And we have launched our own solution. Why?
Our technical perspective: 🤓
- Data-Flow-Control: We want to know what happens to our data.
- Hosting: We host all our models and data on German servers.
- On-Premise: We can run our entire tech stack on-premise without any internet connection
- Our-own-Alan-Model: We optimize our models for dedicated use cases through further training (e.g., better language skills in GER)
- Knowledge-Enrichment: We decide for ourselves whether we want to make new knowledge available through our novel training approach or through our optimized RAG approach (as you might know there are plenty of options).
- Alignment: We have control over the alignment, i.e., to what extent the values and behaviors of the model match our expectations.
- SOTA: We always remain state of the art in a fusion of existing open source base models and in-house developments.
- Benchmarking: We use benchmarks and measures we trust.
With a great team at Comma Soft AG, it's enjoyable to develop such a helpful tool ❤️ In the appended PDF we show an extract of the full text story of our ALAN development journey 📖
Questions: 🤔
- How did you decide if you want to develop something yourself or use more kind of wrappers?
- How important is the management of sensitive data for you and where are your servers located?
Literature: 📚
- Here is the full Humboldt Travel Report with more background stories: https://lnkd.in/emwvpQsW
- Adjusting Model Alignment https://lnkd.in/eWS-VZCD
- Model Selection https://lnkd.in/duGzWugD
- Model Benchmarking https://lnkd.in/dmBeQZ_j
For more GenAI LLM content and R&D discussions, follow me on LinkedIn. If you want to try out Alan, reach out to me: http://alan.de
#artificialintelligence #llm #machinelearning #handson #genai