Modern businesses increasingly rely on LLMs for various applications, but the environmental
impact and user engagement metrics often remain underexplored due to insufficient analytical tools. Co-Innovation Lab at Hochschule München, in collaboration with Intellegam GmbH, a Munich-based high-tech company, has developed EcoLLytics, a solution designed to merge environmental insights with user engagement analytics for using LLM technology.
EcoLLytics: A Unified Approach to Analytics
EcoLLytics is a user-friendly dashboard developed at Co-Innovation Lab at the Hochschule München. An interdisciplinary team of eight students from various fields, including business administration and computer science, collaborated to create this innovative solution. The dashboard not only tracks energy consumption from using LLM technology but also provides detailed insights into user interactions with the LLM.
Marc Gehring, CTO of Intellegam GmbH, emphasizes, “EcoLLytics bridges a crucial gap by integrating sustainability metrics with user engagement analytics, providing a unified dashboard that offers real-time insights and comprehensive monthly reports for LLM usage.
The EcoLLytics dashboard provides actionable insights, such as identifying high energy consumption periods, optimizing model usage, and recommending optimal utilization of LLMs to reduce energy costs and environmental impact. Here are the Key Features of Intellegam EcoLLytics:
User Engagement Analysis: Detailed metrics on user engagement, including daily usage by month, hourly usage by day, and sentiment analysis to track and understand user behaviour and satisfaction levels.
Sustainability Performance: Real-time data on energy consumption per week and cost statistics, providing insights into total energy consumption, daily costs, and CO2 emissions to enhance sustainability efforts.
Operational Efficiency: Monitoring system uptime, success rates of sessions, and model usage distribution to optimize resource allocation and improve overall system performance.
Technical Health: Insights into session durations, average latency, and system response times to quickly identify and address performance bottlenecks and ensure efficient system operations.
Dialog Analysis: Analysis of most asked questions and searched topics to improve user support and tailor content based on common queries and user interests.
Executive Summary: Comprehensive overview of user engagement, sentiment analysis, and model usage, offering actionable insights and data-driven recommendations to enhance user satisfaction, optimize model performance, and align operations with organizational goals.
Using EcoLLytics is straightforward. Companies can integrate their data sources into the dashboard, which then visualizes the data in an intuitive interface. The dashboard offers personalized insights and actionable recommendations, empowering businesses to optimize their operations and reduce their environmental footprint.
The Team
The development of EcoLLytics was a collaborative effort involving students from various academic backgrounds, guided by experienced instructors, including Prof. Dr. Lars Brehm, Prof. Dr. Johannes Ebke, Prof. Dr. Holger Günzel, Prof. Dr. Markus Thimmel, and Hans-Jürgen Haak. This collaboration ensured the project met industry needs, combining academic knowledge with practical application.
About the Co-Innovation Lab
This solution was designed in a project of the Co-Innovation Lab of Hochschule München guided by the lecturers Prof. Dr. Holger Günzel, Prof. Dr. Lars Brehm, Prof. Dr. Markus Thimmel, Prof. Dr. Johannes Ebke, and Hans-Jürgen Haak. The Co-Innovation Lab offers students a virtual platform for learning how to work as a consulting team by creating temporary partnerships between companies, students, and lecturers.
For more information about the Co-Innovation Lab, contact holger.guenzel@hm.edu or lars.brehm@hm.edu.
Team: EcoLLytics