Fosstodon

HabrСекреты Spark в Arenadata Hadoop: как мы ускорили построение витрин для задач MLПривет, Хабр! Я Дмитрий Жихарев, CPO Платформы искусственного интеллекта RAISA в Лаборатории ИИ РСХБ-Интех. В этой статье я и архитектор нашей платформы Александр Рындин @aryndin9999 расскажем о том, как мы построили взаимодействие Платформы ИИ и Озера данных для работы с витринами данных моделей машинного обучения с использованием Spark.<a href="https://habr.com/ru/companies/rshb/articles/904072/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://habr.com/ru/companies/rshb/articles/904072/</a><a href="https://zhub.link/tags/spark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#spark</a> <a href="https://zhub.link/tags/arenadata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#arenadata</a> <a href="https://zhub.link/tags/hadoop" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hadoop</a> <a href="https://zhub.link/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://zhub.link/tags/%D0%B2%D0%B8%D1%82%D1%80%D0%B8%D0%BD%D0%B0_%D0%B4%D0%B0%D0%BD%D0%BD%D1%8B%D1%85" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#витрина_данных</a> <a href="https://zhub.link/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://zhub.link/tags/%D0%BF%D0%BB%D0%B0%D1%82%D1%84%D0%BE%D1%80%D0%BC%D0%B0" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#платформа</a> <a href="https://zhub.link/tags/livy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#livy</a>

LeoAs if it wasn't fast enough already, they made it even faster.<a href="https://clickhouse.com/blog/clickhouse-gets-lazier-and-faster-introducing-lazy-materialization" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://clickhouse.com/blog/clickhouse-gets-lazier-and-faster-introducing-lazy-materialization</a><a href="https://masto.gkbrk.com/tags/ClickHouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClickHouse</a> <a href="https://masto.gkbrk.com/tags/BigData" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#BigData</a> <a href="https://masto.gkbrk.com/tags/DataScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataScience</a> <a href="https://masto.gkbrk.com/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://masto.gkbrk.com/tags/Database" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Database</a>

InfoQShifting Left isn’t just a buzzword - it’s the foundation for efficiency in your organization!By making clean, reliable, and accessible data available across your organization, you reduce complexity and unlock time to focus on higher-value work.💡 Data products are the foundation of this <a href="https://techhub.social/tags/ShiftLeft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ShiftLeft</a>, enabling healthy, scalable data communication.📖 Dive into the details in the <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#InfoQ</a> article: <a href="https://bit.ly/3WHjxsf" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://bit.ly/3WHjxsf</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/DataMesh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataMesh</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ETL</a>

Gytis RepečkaAttended an event Brewing Data with Snowflake yesterday in Vilnius :blobcatnerd:Some of they key insights:<ul><li>Medallion Architecture (good or bad) is widespread.</li><li>Snowflake and Databricks are clear competitors, targeting similar landscape.</li><li>Open formats are trending: file format, table format, catalog, etc. - the more of them are open source, the better.</li><li>Time travel feature is important, many users already used it for disaster recovery.</li><li>Clear distinction of Storage from Compute (generic cloud approach).</li></ul>Full text of one of the slides presented:<blockquote>Strategic Architecture Outlook<ul><li>Agility & Future-Proofing - Open, portable data means you can adopt new technologies or switch platforms with minimal friction. No single vendor can hold your data hostage, so you can evolve vour architecture as needed.</li><li>Multi-Cloud and Hybrid - An open data layer can span clouds and on-prem seamlessly. You avoid cloud vendor lock-in and leverage best-of-breed services on different clouds using the same data. This flexibility is key for resilience and optimization.</li><li>Accelerating Innovation - When any team can access data with the tools of their choice, experimentation flourishes. Open data fosters Al/ML and cross-domain analytics since data isn't locked in silos - more innovation and insights from the same data.</li><li>Vendor Leverage - Strategically, using open standards increases your leverage in vendor negotiations. You car opt in or out of services more freely, pushing vendors to provide value (since you're not irreversibly locked to them).</li></ul></blockquote><a href="https://social.gyt.is/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://social.gyt.is/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://social.gyt.is/tags/datalakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalakehouse</a> <a href="https://social.gyt.is/tags/medallion" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#medallion</a> <a href="https://social.gyt.is/tags/architecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#architecture</a> <a href="https://social.gyt.is/tags/snowflake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snowflake</a> <a href="https://social.gyt.is/tags/vilnius" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#vilnius</a> <a href="https://social.gyt.is/tags/lithuania" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lithuania</a> <a href="https://social.gyt.is/tags/bigdata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bigdata</a> <a href="https://social.gyt.is/tags/event" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#event</a> <a href="https://social.gyt.is/tags/meetup" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#meetup</a>

Justin BuzzardA Data Lake in the software world is essentially where raw data is taken and turned into something tangible like reports, often using AI/machine learning and them put into the Data Warehouse. <a href="https://mastodon.social/tags/software" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#software</a> <a href="https://mastodon.social/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://mastodon.social/tags/datawarehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datawarehouse</a>

Bernhard Luecke🟢 Demo: SAP Business Data Cloud | SAP Business Unleashed <a href="https://youtu.be/OkwQimWDeos?si=UNGdcAVobyMNCkUm" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://youtu.be/OkwQimWDeos?si=UNGdcAVobyMNCkUm</a> via @YouTube (and find related Videos in the SAP channel - see below)<a href="https://techhub.social/tags/SAP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SAP</a> <a href="https://techhub.social/tags/SAPBDC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SAPBDC</a> <a href="https://techhub.social/tags/GenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GenAI</a> <a href="https://techhub.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://techhub.social/tags/DataCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataCloud</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/SAPChampions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SAPChampions</a> <a href="https://techhub.social/tags/SAPBW" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SAPBW</a> <a href="https://techhub.social/tags/SAPDatasphere" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SAPDatasphere</a> <a href="https://a.gup.pe/u/sap" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sap</a>

Sarah LeaThere is no need to move data. Data latency is minimised. Data can be transformed and analysed within a single platform.Let me know what you know about Zero-ETL :blobcoffee: Why ETL-Zero? Understanding the shift in Data Integration“ by Sarah Lea on Medium: <a href="https://medium.com/towards-data-science/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://medium.com/towards-data-science/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154</a><a href="https://techhub.social/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> <a href="https://techhub.social/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://techhub.social/tags/cloudcomputing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cloudcomputing</a> <a href="https://techhub.social/tags/etl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#etl</a> <a href="https://techhub.social/tags/zeroetl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#zeroetl</a> <a href="https://techhub.social/tags/salesforce" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#salesforce</a> <a href="https://techhub.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://techhub.social/tags/tech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#tech</a> <a href="https://techhub.social/tags/technology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#technology</a> <a href="https://techhub.social/tags/datawarehousing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datawarehousing</a> <a href="https://techhub.social/tags/datalakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalakehouse</a>

InfoQA <a href="https://techhub.social/tags/ShiftLeft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ShiftLeft</a> approach to <a href="https://techhub.social/tags/DataProcessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataProcessing</a> relies on data products, which form the basis of data communication across the business.This addresses many flaws in traditional data processing and makes data more relevant, complete, and trustworthy.<a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#InfoQ</a> article: <a href="https://bit.ly/3WHjxsf" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://bit.ly/3WHjxsf</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/DataMesh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataMesh</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ETL</a>

Stefan ZieglerThe house at the lake, Teil 3 - The Dashboard Diaries: <a href="https://blog.sogeo.services/blog/2025/01/26/house-at-the-lake-03.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://blog.sogeo.services/blog/2025/01/26/house-at-the-lake-03.html</a> <a href="https://mstdn.social/tags/Trino" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Trino</a> <a href="https://mstdn.social/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SQL</a> <a href="https://mstdn.social/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://mstdn.social/tags/datalakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalakehouse</a> <a href="https://mstdn.social/tags/lakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lakehouse</a> <a href="https://mstdn.social/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> <a href="https://mstdn.social/tags/apacheiceberg" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#apacheiceberg</a>

InfoQ<a href="https://techhub.social/tags/ApacheHudi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ApacheHudi</a> 1.0 is now generally available!The release introduces new features aimed at transforming data lakehouses into what the project community considers a fully-fledged "Data Lakehouse Management System" (DLMS).Details on <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#InfoQ</a> 👉 <a href="https://bit.ly/3E5AXZi" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://bit.ly/3E5AXZi</a> <a href="https://techhub.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#opensource</a> <a href="https://techhub.social/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataAnalytics</a>

Thilo Dotzel 🤓(Mr. Storage )All in one. Massively scalable, software defined storage (<a href="https://techhub.social/tags/SDS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SDS</a>) for modern workloads with support for file, block and object based applications: ➡️ <a href="https://ibm.com/products/ceph" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://ibm.com/products/ceph</a> 👁🐝Ⓜ️ <a href="https://techhub.social/tags/IBM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IBM</a> <a href="https://techhub.social/tags/RedHat" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RedHat</a> <a href="https://techhub.social/tags/IBMStorage" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IBMStorage</a> <a href="https://techhub.social/tags/IBMStorageCeph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IBMStorageCeph</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/IBMtechnology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IBMtechnology</a> <a href="https://techhub.social/tags/technology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#technology</a> <a href="https://techhub.social/tags/IBMStorageRocks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IBMStorageRocks</a>🚀

Stefan ZieglerThe house at the lake, Teil 2 - Start your engines: <a href="https://blog.sogeo.services/blog/2025/01/12/house-at-the-lake-02.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://blog.sogeo.services/blog/2025/01/12/house-at-the-lake-02.html</a> <a href="https://mstdn.social/tags/Spark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Spark</a> <a href="https://mstdn.social/tags/ApacheIceberg" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ApacheIceberg</a> <a href="https://mstdn.social/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SQL</a> <a href="https://mstdn.social/tags/Datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Datalake</a> <a href="https://mstdn.social/tags/Lakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Lakehouse</a> <a href="https://mstdn.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a>

Stefan ZieglerThe house at the lake, Teil 1- Iceberg ahead. Data Lakehouse baby steps. <a href="https://blog.sogeo.services/blog/2025/01/05/house-at-the-lake-01.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://blog.sogeo.services/blog/2025/01/05/house-at-the-lake-01.html</a> <a href="https://mstdn.social/tags/ApacheIceberg" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ApacheIceberg</a> <a href="https://mstdn.social/tags/Spark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Spark</a> <a href="https://mstdn.social/tags/Pyspark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Pyspark</a> <a href="https://mstdn.social/tags/Datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Datalake</a> <a href="https://mstdn.social/tags/Lakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Lakehouse</a>

Sarah LeaOne of the most highlighted parts: "There is no need to move data. Data latency is minimised. Data can be transformed and analysed within a single platform.“This is one of the reasons for 'Why ETL-Zero' :blobcoffee: <a href="https://towardsdatascience.com/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://towardsdatascience.com/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154</a><a href="https://techhub.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://techhub.social/tags/datascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datascience</a> <a href="https://techhub.social/tags/dataanalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataanalysis</a> <a href="https://techhub.social/tags/dataanalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataanalytics</a> <a href="https://techhub.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataEngineering</a> <a href="https://techhub.social/tags/sql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sql</a> <a href="https://techhub.social/tags/salesforce" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#salesforce</a> <a href="https://techhub.social/tags/etl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#etl</a> <a href="https://techhub.social/tags/datawarehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datawarehouse</a> <a href="https://techhub.social/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://techhub.social/tags/datalakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalakehouse</a> <a href="https://techhub.social/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#programming</a>

Marcel SIneM(S)US<a href="https://infosec.space/@kkarhan" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@kkarhan</a> :mastolol: <a href="https://social.tchncs.de/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> ... sehr gut ... so kreativ war ich noch nicht. Aber ja: Aus einem <a href="https://social.tchncs.de/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> kann schnell ein <a href="https://social.tchncs.de/tags/DataLeak" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLeak</a> werden

2meterdba | Reitse EskensIt's december and that means lighting talk time for our user group! Join us online for some short, powerful insights from both known and new speakers! Follow the link to sign up and see you next tuesday. <a href="https://mastodon.nl/tags/Meetup" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Meetup</a> <a href="https://mastodon.nl/tags/Community" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Community</a> <a href="https://mastodon.nl/tags/LightningTalk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LightningTalk</a> <a href="https://mastodon.nl/tags/Microsoft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Microsoft</a> <a href="https://mastodon.nl/tags/DataPlatform" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataPlatform</a> <a href="https://mastodon.nl/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.nl/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a> <a href="https://mastodon.nl/tags/Azure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Azure</a> <a href="https://mastodon.nl/tags/PowerBI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PowerBI</a> <a href="https://mastodon.nl/tags/SQLServer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SQLServer</a> <a href="https://mastodon.nl/tags/Clarity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Clarity</a> <a href="https://mastodon.nl/tags/DataDriven" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataDriven</a> <a href="https://www.meetup.com/groningen-microsoft-data-meetup-groep/events/298279290/?utm_medium=referral&utm_campaign=share-btn_savedevents_share_modal&utm_source=link" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.meetup.com/groningen-microsoft-data-meetup-groep/events/298279290/?utm_medium=referral&utm_campaign=share-btn_savedevents_share_modal&utm_source=link</a>

Sarah LeaIn a data warehouse you store structured & organized data. In a data lake you can additionally store unstructured data. And was is now a data lakehouse? Think of a combination of the strengths of both previous data platforms. :blobcoffee: <a href="https://towardsdatascience.com/sql-and-data-modelling-in-action-a-deep-dive-into-data-lakehouses-fcbab9a4b9c2" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://towardsdatascience.com/sql-and-data-modelling-in-action-a-deep-dive-into-data-lakehouses-fcbab9a4b9c2</a><a href="https://techhub.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://techhub.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataEngineering</a> <a href="https://techhub.social/tags/datalakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalakehouse</a> <a href="https://techhub.social/tags/datacenters" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datacenters</a> <a href="https://techhub.social/tags/datawarehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datawarehouse</a> <a href="https://techhub.social/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://techhub.social/tags/datascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datascience</a> <a href="https://techhub.social/tags/sql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sql</a>

Dirk Van den PoelToday’s Session of my Big Data Analytics Class is a guest lecture by Element61 professionals discussing ML projects in the real world. It has become a yearly tradition. <a href="https://mastodon.online/tags/orms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#orms</a> <a href="https://mastodon.online/tags/DS4B" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DS4B</a> <a href="https://mastodon.online/tags/DataScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataScience</a> <a href="https://mastodon.online/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataAnalytics</a> <a href="https://mastodon.online/tags/Datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Datalake</a> <a href="https://mastodon.online/tags/AzureDataFactory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AzureDataFactory</a> <a href="https://mastodon.online/tags/orchestration" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#orchestration</a> tool <a href="https://mastodon.online/tags/Azure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Azure</a>

Dirk Van den PoelIn Today’s Session of my <a href="https://mastodon.online/tags/BigDataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#BigDataAnalytics</a> Class Brammert talks about the different roles in Data Management, scrum project management, ETL pipelines, repositories, medallion data architecture, CI/CD, orchestration, … <a href="https://mastodon.online/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataEngineering</a> <a href="https://mastodon.online/tags/DataScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataScience</a> <a href="https://mastodon.online/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataAnalytics</a> <a href="https://mastodon.online/tags/DataLake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataLake</a>

🏁⚡Omar Two Tone⚡🏁:verified:** you wouldn't understand this level of sophistication.. 🚬 ** 😆 🤪 <a href="https://ioc.exchange/tags/excel" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#excel</a> <a href="https://ioc.exchange/tags/excelisnotdatabase" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#excelisnotdatabase</a> <a href="https://ioc.exchange/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://ioc.exchange/tags/dataanalyst" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataanalyst</a> <a href="https://ioc.exchange/tags/datalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#datalake</a> <a href="https://ioc.exchange/tags/lol" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lol</a> <a href="https://ioc.exchange/tags/meme" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#meme</a>

Recent searches

Search options

Administered by:

Server stats:

#datalake