Executive Summary

Key Updates

Team

  • New member has joined the team.

Milestones

Visualization

Data Extraction

Infrastructure

  • Data Lake:
    • Finish deployment of Test Environment.
    • Start deploying of environment.

Others

  • Automatic Grafana, backup of all dashboard.
  • Internal documentation improvement.
  • Start working on data query using LLM.
  • Building RAG to improve IFT LLM with Internal documentation.

Future Plans

Visualization

Data extraction

Infrastructure

  • Data Lake:
    • Finishing the Prod environment
    • Connect all the BI tools to the Data lake
  • Data Hub: Tool deployment to provide a Catalog of the Data available
  • Dagster: Research and test alternative solution to Airflow
  • Deploy Vector Database for LLM work.
  • Decommission of Superset instances

Insight