Welcome to Marvin - Marvin
https://www.askmarvin.ai/

The Truth about Prefect, Mage, and Airflow.
https://dataengineeringcentral.substack.com/p/the-truth-about-prefect-mage-and

Steampipe | select * from cloud;
https://steampipe.io/

MLOps Is Overfitting: Here’s Why
https://lakefs.io/blog/mlops-is-overfitting/

The future of the data engineer — Part I | by Analytics at Meta | Apr, 2023 | Medium
https://medium.com/@AnalyticsAtMeta/the-future-of-the-data-engineer-part-i-32bd125465be

Introducing AI Functions: Integrating Large Language Models with Databricks SQL - The Databricks Blog
https://www.databricks.com/blog/2023/04/18/introducing-ai-functions-integrating-large-language-models-databricks-sql.html?utm_source=bambu&utm_medium=social&utm_campaign=advocacy

Open source self-hosted Delta Sharing server | Delta Lake
https://delta.io/blog/2023-04-24-open-source-selfhosted-delta-sharing-server/

dbt Guide | GitLab
https://about.gitlab.com/handbook/business-technology/data-team/platform/dbt-guide/

Microsoft introduced Fabric, which is a combination of Power BI, Azure Synapse, Data Factory and Data Explorer on top of ADLS gen2 using Delta (Parquet) as data lake format. A new component is Data Activator which seems to be a no-code rule engine.
https://azure.microsoft.com/en-us/blog/introducing-microsoft-fabric-data-analytics-for-the-era-of-ai/

Thread about how Slack uses Apache Kafka at scale.

The State of Data Engineering 2023
https://lakefs.io/blog/the-state-of-data-engineering-2023/

Microsoft OneLake in Fabric, the OneDrive for data.

This is huge! PowerBI now has
Git integration and Power BI Desktop ‘Developer Mode' which means you can edit files in code editor like VSCode and deploy them using PowerBI deployment pipelines. In other words "dashboards as a code". Apparently, this functionality was added to enable Copilot.

Empower every BI professional to do more with Microsoft Fabric
https://build.microsoft.com/en-US/sessions/8b23c96e-7c35-463d-88b4-564d23dc14a5