fosstodon.org is one of the many independent Mastodon servers you can use to participate in the fediverse.
Fosstodon is an invite only Mastodon instance that is open to those who are interested in technology; particularly free & open source software. If you wish to join, contact us for an invite.

Administered by:

Server stats:

10K
active users

#airbyte

0 posts0 participants0 posts today
Natik Gadzhi<p>Here's my year in review: a bunch of things we've shipped at <a href="https://hachyderm.io/tags/Airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Airbyte</span></a>! </p><p><a href="https://respawn.io/posts/airbyte-2024-in-review" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">respawn.io/posts/airbyte-2024-</span><span class="invisible">in-review</span></a></p><p>First year full-time in open source dev tool eng leadership role. Working in the open is fun! 🙃</p>
Philipp Krenn<p>launch party for <a href="https://mastodon.social/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a> 1.0</p>
Fish in the Percolator<p>Done a new <a href="https://fosstodon.org/tags/ArchLinux" class="mention hashtag" rel="tag">#<span>ArchLinux</span></a> package, &quot;abctl&quot; to control local <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a> installations.</p><p><a href="https://aur.archlinux.org/packages/abctl" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">aur.archlinux.org/packages/abc</span><span class="invisible">tl</span></a></p><p>This was the first one in a long while, had to look up a lot of things about PKGBUILDs again...</p>
Dr James Ravenscroft<p>I wrote a blog post about how I&#39;m using Sling (<a href="https://slingdata.io/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="">slingdata.io/</span><span class="invisible"></span></a>) inside our <a href="https://fosstodon.org/tags/CI" class="mention hashtag" rel="tag">#<span>CI</span></a> runners to copy data around between <a href="https://fosstodon.org/tags/mysql" class="mention hashtag" rel="tag">#<span>mysql</span></a> databases and storage providers like <a href="https://fosstodon.org/tags/gcs" class="mention hashtag" rel="tag">#<span>gcs</span></a> <a href="https://fosstodon.org/tags/s3" class="mention hashtag" rel="tag">#<span>s3</span></a> </p><p>We were paying £500/mo/customer just for servers powerful enough to run <a href="https://fosstodon.org/tags/airbyte" class="mention hashtag" rel="tag">#<span>airbyte</span></a> to do this before. Now it&#39;s &quot;free&quot; since the CI workers are already bought + paid for.</p><p>Incredible work by the maintainers</p><p><a href="https://brainsteam.co.uk/2024/08/29/data-export-in-bulk-inside-your-ci-pipeline-with-sling/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">brainsteam.co.uk/2024/08/29/da</span><span class="invisible">ta-export-in-bulk-inside-your-ci-pipeline-with-sling/</span></a></p>
Dr James Ravenscroft<p>I have replaced <a href="https://fosstodon.org/tags/airbyte" class="mention hashtag" rel="tag">#<span>airbyte</span></a> and <a href="https://fosstodon.org/tags/airflow" class="mention hashtag" rel="tag">#<span>airflow</span></a> and <a href="https://fosstodon.org/tags/dbt" class="mention hashtag" rel="tag">#<span>dbt</span></a> with a shell script and a cron job. I am very happy. There&#39;s just no need for gigs and gigs of software for copying a few rows out of a SQL database over to a storage bucket. Keep it simple stupid!</p>
Schrank :shopware: 🐘 (er/ihm)<p>I'm playing around with <a href="https://phpc.social/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a> and it seems, it is not easily possible to include it in my own docker-compose.yaml so I just use </p><p>include:<br> - airbyte/docker-compose.yaml</p><p>Can anyone tell me how to connect my mysql to it?<br>services:<br> mysql:<br> image: mysql:8.0</p><p>I thought adding a connection to "mysql" should do it, but it doesn't.<br>Then I tried to link mysql to the airbyte server<br> links:<br> - server<br>But this doesn't help either.</p><p><a href="https://phpc.social/tags/Help" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Help</span></a>?</p>
Chris Burgess<p>taking <a href="https://toot.cafe/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a> for a hoon</p>
R Tyler Croy 🦀<p>If your organization has performance challenges with <a href="https://hacky.town/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a>, please let me know! (rtyler@buoyantdata.com)</p><p>I'm looking for funding to convert some key connectors to <a href="https://hacky.town/tags/rustlang" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rustlang</span></a> for improved speed and reliability!</p>
Open Source JobHub<p>Featured Job at <span class="h-card" translate="no"><a href="https://hachyderm.io/@openuk" class="u-url mention">@<span>openuk</span></a></span> <a href="https://fosstodon.org/tags/SOOCon24" class="mention hashtag" rel="tag">#<span>SOOCon24</span></a>: The open-source standard for EL(T), <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a> is seeking a remote Technical Support Engineer in the UK. Learn more about this position and other openings on <a href="https://fosstodon.org/tags/OSJH" class="mention hashtag" rel="tag">#<span>OSJH</span></a> <a href="https://opensourcejobhub.com/company/585/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">opensourcejobhub.com/company/5</span><span class="invisible">85/</span></a> <a href="https://fosstodon.org/tags/engineer" class="mention hashtag" rel="tag">#<span>engineer</span></a> <a href="https://fosstodon.org/tags/support" class="mention hashtag" rel="tag">#<span>support</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/API" class="mention hashtag" rel="tag">#<span>API</span></a> <a href="https://fosstodon.org/tags/FOSS" class="mention hashtag" rel="tag">#<span>FOSS</span></a> <a href="https://fosstodon.org/tags/sales" class="mention hashtag" rel="tag">#<span>sales</span></a> <a href="https://fosstodon.org/tags/writer" class="mention hashtag" rel="tag">#<span>writer</span></a> <a href="https://fosstodon.org/tags/BizOps" class="mention hashtag" rel="tag">#<span>BizOps</span></a> <a href="https://fosstodon.org/tags/database" class="mention hashtag" rel="tag">#<span>database</span></a> <a href="https://fosstodon.org/tags/SoftwareEngineer" class="mention hashtag" rel="tag">#<span>SoftwareEngineer</span></a></p>
Habr<p>Как мы не выбрали Airbyte</p><p>Привет, Хабр! Меня зовут Илья, я работаю инженером данных в компании</p><p><a href="https://habr.com/ru/companies/selectel/articles/788302/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">habr.com/ru/companies/selectel</span><span class="invisible">/articles/788302/</span></a></p><p><a href="https://zhub.link/tags/selectel" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selectel</span></a> <a href="https://zhub.link/tags/dwh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dwh</span></a> <a href="https://zhub.link/tags/etl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>etl</span></a> <a href="https://zhub.link/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a> <a href="https://zhub.link/tags/%D0%B0%D0%BD%D0%B0%D0%BB%D0%B8%D1%82%D0%B8%D0%BA%D0%B0" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>аналитика</span></a> <a href="https://zhub.link/tags/airflow" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airflow</span></a> <a href="https://zhub.link/tags/bi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bi</span></a></p>
Joe Wood<p>Useful summary of the <a href="https://writing.exchange/tags/dataengineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataengineering</span></a> stack. Missing for me are the extract, load tools like <a href="https://writing.exchange/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a>, <a href="https://writing.exchange/tags/meltano" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>meltano</span></a>. Would have liked to see some governance tooling to support data mesh, catalog support too. </p><p><a href="https://thenewstack.io/the-architects-guide-to-the-modern-data-stack/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">thenewstack.io/the-architects-</span><span class="invisible">guide-to-the-modern-data-stack/</span></a></p><p><a href="https://writing.exchange/tags/databuildtool" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databuildtool</span></a></p>
M.D. Weatherspoon<p>I was able to connect <a href="https://fosstodon.org/tags/CiviCRM" class="mention hashtag" rel="tag">#<span>CiviCRM</span></a> ’s API to <a href="https://fosstodon.org/tags/Postgres" class="mention hashtag" rel="tag">#<span>Postgres</span></a> in <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a>. Now what? 🤔</p>
R Tyler Croy 🦀<p>I am looking for a Rust/Python developer who might be interested in some fixed bid contract work to develop custom high performance open source <a href="https://hacky.town/tags/Airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Airbyte</span></a> connectors.</p><p>Please drop me a line! rtyler@buoyantdata.com</p>
Chris Burgess<p><span class="h-card"><a href="https://fosstodon.org/@pn3uma" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>pn3uma</span></a></span> which site is denying you, the <a href="https://toot.cafe/tags/airbyte" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airbyte</span></a> end or the <a href="https://toot.cafe/tags/civicrm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>civicrm</span></a>? Consider also it could be at CMS layer (depending on your setup)</p>
Dr James Ravenscroft<p>I recently spent some time configuring <a href="https://fosstodon.org/tags/airbyte" class="mention hashtag" rel="tag">#<span>airbyte</span></a> for to allow some of my clients to do data science stuff on up-to-date transactional data. I wrote about my experience and provided some tips for others who might consider using Airbyte as their <a href="https://fosstodon.org/tags/ELT" class="mention hashtag" rel="tag">#<span>ELT</span></a> tool <a href="https://brainsteam.co.uk/2023/8/14/stable-airbyte-sync/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">brainsteam.co.uk/2023/8/14/sta</span><span class="invisible">ble-airbyte-sync/</span></a></p>
Open Source JobHub<p>Remote-friendly Airbyte is seeking open source professionals including developers and engineers. Browse open positions now on <a href="https://fosstodon.org/tags/OSJobHub" class="mention hashtag" rel="tag">#<span>OSJobHub</span></a> <a href="https://opensourcejobhub.com/company/585/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">opensourcejobhub.com/company/5</span><span class="invisible">85/</span></a> <a href="https://fosstodon.org/tags/jobs" class="mention hashtag" rel="tag">#<span>jobs</span></a> <a href="https://fosstodon.org/tags/career" class="mention hashtag" rel="tag">#<span>career</span></a> <a href="https://fosstodon.org/tags/engineer" class="mention hashtag" rel="tag">#<span>engineer</span></a> <a href="https://fosstodon.org/tags/developer" class="mention hashtag" rel="tag">#<span>developer</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/data" class="mention hashtag" rel="tag">#<span>data</span></a> <a href="https://fosstodon.org/tags/RemoteWork" class="mention hashtag" rel="tag">#<span>RemoteWork</span></a> <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a></p>
Open Source JobHub<p>Operating with the belief that an open source approach can solve data integration problems, Airbyte is seeking technical and non-technical professionals to join its team. Browse current openings on <a href="https://fosstodon.org/tags/OSJobHub" class="mention hashtag" rel="tag">#<span>OSJobHub</span></a> <a href="https://opensourcejobhub.com/company/585/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">opensourcejobhub.com/company/5</span><span class="invisible">85/</span></a> <a href="https://fosstodon.org/tags/jobs" class="mention hashtag" rel="tag">#<span>jobs</span></a> <a href="https://fosstodon.org/tags/career" class="mention hashtag" rel="tag">#<span>career</span></a> <a href="https://fosstodon.org/tags/marketing" class="mention hashtag" rel="tag">#<span>marketing</span></a> <a href="https://fosstodon.org/tags/SoftwareEngineer" class="mention hashtag" rel="tag">#<span>SoftwareEngineer</span></a> <a href="https://fosstodon.org/tags/intern" class="mention hashtag" rel="tag">#<span>intern</span></a> <a href="https://fosstodon.org/tags/infrastructure" class="mention hashtag" rel="tag">#<span>infrastructure</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a></p>
Open Source JobHub<p>Solving the problem of data integration with <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a>, Airbyte is seeking technical and non-technical professionals to join its team. Browse current openings on <a href="https://fosstodon.org/tags/OSJobHub" class="mention hashtag" rel="tag">#<span>OSJobHub</span></a> <a href="https://opensourcejobhub.com/company/585/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">opensourcejobhub.com/company/5</span><span class="invisible">85/</span></a> <a href="https://fosstodon.org/tags/jobs" class="mention hashtag" rel="tag">#<span>jobs</span></a> <a href="https://fosstodon.org/tags/career" class="mention hashtag" rel="tag">#<span>career</span></a> <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a> <a href="https://fosstodon.org/tags/marketing" class="mention hashtag" rel="tag">#<span>marketing</span></a> <a href="https://fosstodon.org/tags/SoftwareEngineer" class="mention hashtag" rel="tag">#<span>SoftwareEngineer</span></a> <a href="https://fosstodon.org/tags/JavaScript" class="mention hashtag" rel="tag">#<span>JavaScript</span></a> <a href="https://fosstodon.org/tags/data" class="mention hashtag" rel="tag">#<span>data</span></a> <a href="https://fosstodon.org/tags/sales" class="mention hashtag" rel="tag">#<span>sales</span></a> <a href="https://fosstodon.org/tags/cloud" class="mention hashtag" rel="tag">#<span>cloud</span></a> <a href="https://fosstodon.org/tags/security" class="mention hashtag" rel="tag">#<span>security</span></a></p>
Open Source JobHub<p>An open source data integration engine for the modern data stack, <a href="https://fosstodon.org/tags/Airbyte" class="mention hashtag" rel="tag">#<span>Airbyte</span></a> helps clients unify all data pipelines. Check out its current job openings on <a href="https://fosstodon.org/tags/OSJobHub" class="mention hashtag" rel="tag">#<span>OSJobHub</span></a> <a href="https://opensourcejobhub.com/company/585/" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">opensourcejobhub.com/company/5</span><span class="invisible">85/</span></a> <a href="https://fosstodon.org/tags/jobs" class="mention hashtag" rel="tag">#<span>jobs</span></a> <a href="https://fosstodon.org/tags/career" class="mention hashtag" rel="tag">#<span>career</span></a> <a href="https://fosstodon.org/tags/marketing" class="mention hashtag" rel="tag">#<span>marketing</span></a> <a href="https://fosstodon.org/tags/SoftwareEngineer" class="mention hashtag" rel="tag">#<span>SoftwareEngineer</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/API" class="mention hashtag" rel="tag">#<span>API</span></a> <a href="https://fosstodon.org/tags/data" class="mention hashtag" rel="tag">#<span>data</span></a> <a href="https://fosstodon.org/tags/sales" class="mention hashtag" rel="tag">#<span>sales</span></a> <a href="https://fosstodon.org/tags/cloud" class="mention hashtag" rel="tag">#<span>cloud</span></a></p>
Fish in the Percolator<p>I see going down a rabbit hole of JSON Schema is coming my way.</p><p>When tools like <a href="https://fosstodon.org/tags/AirByte" class="mention hashtag" rel="tag">#<span>AirByte</span></a> use it and their example usage, docs, etc are all over the place, that is kinda difficult to handle for any non absolut trivial cases without doing one&#39;s own research. Now just have to shorten the feedback cycle.</p><p>Currently trying to describe a field for AirByte that the original API can return either as a boolean or an integer, and trying to guess how that will end up after the transformations in BigQuery.</p>