CAST 2025 offers you the biggest bang for your hard earned dollar when looking at conferences and upskilling events this year.

Don't miss this opportunity to level up your testing skills and strategies in preparation for the next era of testing and quality. Register today!

https://associationforsoftwaretesting.org/conference/cast-2025/

Wusstest du? Hyperpersonalisierte KI-Anwendungen steigern die Conversion Rate um 43%! In meinem neuen Video zeige ich, wie du personalisierte Customer Journeys mit Cypress testen kannst. #WebDevelopment #AITesting https://youtube.com/shorts/CjrsFo1Yuhw

David Berenstein has joined the Giskard team as DevRel ️

David brings valuable experience from his previous roles at Argilla and Hugging Face, where he helped developers discover the joys of working with (synthetic) data. He loves cooking things up with data but also commits a lot of his time to cooking in real life His expertise will be key as we build our LLM Evaluation Hub.

Welcome to the team, David!

It's that wonderful day of the week when we get to drop news about our next invited speaker at CAST 2025... you all getting excited? We sure are!

Welcome Péter Földházi!

Learn more about Péter in our substack: https://associationforsoftwaretesting.substack.com/p/cast-2025-invited-speaker-announcement-609?r=57k72m

And don't forget to secure your CAST 2025 seat before prices go up!

We recently tested several AI engines across three key areas: Temporal Awareness, RAG, and Comprehension. Our findings revealed interesting variations in performance

https://www.alanbonnici.com/2025/03/ai-got-it-wrong-news.html

Is AI the future of test automation? Alex Rodionov introduces Alumnium, an open-source AI-powered framework that overcomes the challenges of automated testing.
https://seleniumconf.com/register/
#AITesting #TestAutomation #Alumnium #OpenSource #SeleniumConf #AppiumConf

AST NEWSLETTER FOR FEBRUARY IS OUT!
The conversation around AI-driven testing tools is reaching fever pitch, but does the technology live up to its billing? In this month’s news spotlight, we explore the real-world impact, technical hurdles, and a call to action for testers to share concrete results.

Also get your latest updates on CAST 2025!

https://open.substack.com/pub/associationforsoftwaretesting/p/ast-monthly-newsletter?r=57k72m&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false

This Friday is the last day for AST members to save over $300 off registration for CAST 2025...

Have you secured your spot?

REGISTER BEFORE PRICES INCREASE: https://associationforsoftwaretesting.org/.../cast-2025.../

Mar. 1st is quickly approaching and CAST2025 registration prices will be going up 3/1 and opening to the public.

This is your reminder!! Secure up to 30% off of registration before 2/28!

REGISTER NOW: https://associationforsoftwaretesting.org/conference/cast-2025/

Can we trust DeepSeek R1? A Giskard evaluation

With all the hype around DeepSeek R1, our LLM safety research team decided to conduct an evaluation to check if R1 is as good as it claims. While it impresses in some areas, we found critical limitations that raise concerns for real-world applications. Here are some unexpected examples

Reviewing DeepSeek-R1-Distill-Llama-8B on an M1 Mac
▸ https://lttr.ai/AbDLG

I’ve been testing DeepSeek-R1-Distill-Llama-8B on my M1 Mac using LMStudio, and the results have been surprisingly strong for a distilled model.

Read more https://lttr.ai/Aa4FO

CAIS & Scale AI unveil Humanity's Last Exam—a 3,000-question AI test dubbed the hardest-ever evaluation. #AI #ArtificialIntelligence #CAIS #ScaleAI #TechNews #MachineLearning #Innovation #AITesting #FutureTech

Seek for the turtle in Cannes!

Join us at the World AI Cannes Festival (WAICF) from February 13-15!

Stop by our booth and meet our team to discuss about quality, security, and compliance for GenAI applications.
More detail about our participation coming soon...

Are you attending WAICF? Drop a comment below or DM us to schedule a meeting.

Me: How many letters 'r' are there in the word 'strawberry'?

ChatGPT answers: There are three occurrences of the letter ‘r’ in the word ‘strawberry’.

ChatGPT, in another chat answers: The word strawberry contains three letters ‘r’.

(This is better than the '2', 2 months ago when I first asked).

Google's Gemini: There are 3 letters "r" in the word "strawberry."

(First time of use for questions of this type).

️ Building and evaluating a Banking Supervision #RAG agent

We've published a new tutorial that shows how to:
• Build a RAG agent with LlamaIndex to answer questions about ECB banking supervision
• Scan for LLM vulnerabilities like hallucinations and prompt injection
• Evaluate RAG components (retriever, generator, rewriter) with different question types

Check out the complete tutorial in our docs: https://gisk.ar/3OQ1tYz
More details about the results