Executive Summary
Key Updates
Main Focus
The main focus of the month have been:
- Building metrics for Github community engagement
- Building IFT RAG using internal documentation
- Providing Website analytics
- Extracting social media data to build give sentiment analysis of community interaction
- Deploy a Metadata Catalog and present DataHub in Townhall.
Visualization
- Keycard - Social Media Dashabord: https://grafana.bi.status.im/d/aenu0t2u920hsd/keycard-global-analytics?orgId=1&from=now-90d&to=now&timezone=browser
- Discord - Show public activity
- Twitter - Visualize the posts interracting with our accounts https://superset.bi.status.im/superset/dashboard/twitter-tagged-messages
- Podcasts - Create analytics for Youtube and Twitter Accounts https://superset.bi.status.im/superset/dashboard/youtube-analytics
Data Extraction
- Social media:
- Improve Discord extraction
- Extract Tweets interracting without our tags
AI Solution
- Retrieval of Data extracted.
- Build Pipelines for clean retrieval
- testing different models
Infrastructure
- Deploy RAG test environment
- Finish configuring DataHub synchronization
- Migrate Production host for better price / quality
Future Plan
Visualization
- Improve dashboard for Status Website analytics
- Create Dashboard to monitor Waku bandwith and messages rate.
Data Extraction
- Narative building: extract history to build narative on.
- Status App - Extract Paraswap data
- Status Network - Improve the data extraction
- Finance: Extract platform where SNT is listed
- Insight, help extracting FURBS and milestones of different project
AI Solution
- Deploy the Prod environment and make it available to all CCs.
- Enhance sentiment analysis by adding translation and include more data source.
Infrastructure
- IFT LLM - Finish building the environment Pipeline
- Prod environment ready for usage
- Townhall presentation
- Data Lake: Optimizing the prod environment
Sources and Useful Links
- Repository to create new issues: If your team need some Visualization or access to some data, please create an issue in this repository
- BI documentation
- Data Catalog