ADMIN 85: Monitoring is available now. We look at infrastructure and systems monitoring and evaluate the
tools needed to scale or store data in the long term for analysis.
https://mailchi.mp/admin-magazine.com/admin-magazine-preview-issue-85-monitoring
#sysadmin #monitoring #Bloonix #Prometheus #Talos #Kubeflow #Kubernetes #AI #Podman #security #Keras #Fedora

Achieve better large language model inference with fewer GPUs

"we achieved approximately 55-65% of the throughput on a server config that is approximately 15% of the cost"

https://www.redhat.com/en/blog/achieve-better-large-language-model-inference-fewer-gpus

Get ready for KubeCon next week! Below are the three talks I'll be presenting! See you there! https://github.com/terrytangyuan/public-talks

- Cloud Native AI Day Keynote: Advancing Cloud Native AI Innovation Through Open Collaboration, sponsored by Red Hat

- Unlocking Potential of Large Models in Production with Adam Tetelman

- WG Serving: Accelerating AI/ML Inference Workloads on Kubernetes with Eduardo Arango

Consume GPUs of a K8s cluster from... another K8s cluster

It's exactly like your pods would run locally on your nodes. The trick is presented by the guys from Liqo in this episode of #SciGeeks' Podcast!

https://www.youtube.com/live/Wtw-qE9Veh8?si=jC5TUjl7bgMlpH_0

Watch it and if you enjoy it, stay tuned

AI/ML Innovation in the Kubernetes Ecosystem

https://dzone.com/articles/ai-ml-innovation-in-the-kubernetes-ecosystem

Excited to share that I am starting my two-year term on the #Kubeflow Steering Committee on behalf of Red Hat!

Johnu George (Nutanix), Andrey Velichkevich (Apple), and I have been collaborating for years on various Kubeflow subprojects and I look forward to working with them more closely.

Together with the Kubeflow community, #CNCF ecosystem projects, organizations, and partners, I am confident that we will steer the project towards a successful CNCF journey.

Implement MLOps with Kubeflow Pipelines https://developers.redhat.com/articles/2024/01/25/implement-mlops-kubeflow-pipelines
#mlops #kubeflow #Kubernetes #aiml

https://fmind.medium.com/how-to-install-kubeflow-on-apple-silicon-3565db8773f3 - installing #KubeFlow, #ML workflow for #Kubernetes. It can get a bit tricky. Thanks for the walk-through https://www.linkedin.com/in/fmind-dev/

Canonical (Ubuntu) & machine learning | Charmed MLFlow released

Charmed MLFlow is ideal for model registry and experiment tracking - it is also integrated with other AI / big data tools such as Apache Spark and Kubeflow.

This solution runs on any infrastructure - from workstations to public and private clouds.

=> https://ubuntu.com/blog/canonical-releases-charmed-mlflow

Today, I got to try our new project #MLOps platform, including #MinIO, #KubeFlow, and #MLFlow for the first time. Looking forward to exploring more as part of @emeraldseu

What is #Kubeflow?

It's an open-source, Kubernetes-native MLOps platform for developing & deploying distributed ML for the most popular: TensorFlow, PyTorch, and more.

Check out more details on #InfoQ: https://bit.ly/3YXaSBR

Neues Video «Ein Mate mit...» über Machine Learning und #MLOps.

Iwan Imsand, Software Engineer bei Puzzle, nimmt dich in die faszinierende Welt des Machine Learnings mit. Von den Feinheiten zwischen #AI, #MachineLearning und #DeepLearning bis hin zu schicken Open Source Tools, wie: #DVC, #CML, #MLflow, #Kubeflow.

Und weil wir bei Puzzle auch gerne komplexe Probleme lösen, zeigen wir dir, wie wir Unternehmen im MLOps Bereich unterstützen können.

glad to see #MLOps growing within the CNCF. the @kubeflow project has been around since 2017, offering a #cloudnative solution to deploy machine learning workloads on #kubernetes.
Congrats to the #kubeflow team
https://cncf.io/blog/2023/07/25/kubeflow-brings-mlops-to-the-cncf-incubator/
#MachineLearning #DevOps

It's fascinating to look at the Linux Foundation AI & Data landscape which explores open source projects in Artificial Intelligence and Data and their respective sub-domains, with market cap of $15.4T and funding of $13.9B.

https://landscape.lfai.foundation/

Registrations for the fifth edition of the International School on Open Science Cloud are now open #SOSC23 For more details visit: https://web.infn.it/SOSC23 #OpenScience #CloudComputing #DataScience #ArgoWorkflows #kubeflow

can you contain #kubeflow inside #vcluster and still have access to #gpu on the nodes?

Good morning folx of #Fediverse ! I interrupt swearing at #CUDA and #Torch to bring you today's #ConnectionList #Introduction #FollowFriday, where I help to more richly connect the Fediverse.

@terrytangyuan is a #MachineLearning #Kubernetes #OpenSource #MLOps engineer who is co-chair of #KubeFlow and maintains #TensorFlow (thank you!).

@yarnspinner is a #dialogue #dialog tool for #GamesDev, brought to you by the team @thesecretlab

@Cerchie is Lucia who is a #DevRel #DeveloperAdvocate at #Confluent, based in the

@ocramz is Marco and he is into #MachineLearning #ML #NLP #λ #lambda and #NLProc

@lira is into #poetry, #ComputerScience and #Philosophy

@frankjhopwood is a #PhD candidate #researcher #academic at #Groningen working on #speech technology #SpeechSynthesis #TTS for #Frisian. Fun Frisian fact: did you know that "keks" in Frisian means "cookies"?! Cakes and cookies! (Sorry I've always found that very amusing! )

@blairpalese is Director of #Philanthropy at #EthInvest and Media Director and Editor at Climate and Capital Media. She's into #GreenFinance #ClimateRisk #Environment

Don't forget to share your own #ConnectionList so we can connect more widely

I’m going to be adding tests to our #FluxFramework #Kubernetes operator this week! I’ve seen scorecard for the operator-sdk but I’m looking for examples in the wild using best practices, and possibly not sticking to those suggested by that SDK. The e2e and unit tests in the #kubeflow MPI operator with ginkgo and gomega look nice! https://github.com/kubeflow/mpi-operator/blob/master/v2/test/e2e/mpi_job_test.go Anyone have other examples they like or experiences to share?

Dino #koobernottie