fosstodon.org is one of the many independent Mastodon servers you can use to participate in the fediverse.
Fosstodon is an invite only Mastodon instance that is open to those who are interested in technology; particularly free & open source software. If you wish to join, contact us for an invite.

Administered by:

Server stats:

11K
active users

linus-next: improving functional testing for to-be-merged [ ] pull requests

lore.kernel.org/all/ZxZ8MStt4e

"'[…] Linus Torvalds expressed concerns about the quality of testing that code receives before he pulls it. The subsequent discussion side-tracked to the testability of linux-next, but we didn't directly address Linus's original concern about pre-pull testing quality.

In an attempt to address the concerns, we're trying out a new "linus-next"
tree […]"

lore.kernel.orglinus-next: improving functional testing for to-be-merged pull requests - Sasha Levin

2/ @kees replied to the "linus-next" proposal from Sasha and raised a few points I fully agree with, as that proposal felt a bit off for me.

lore.kernel.org/all/792F4759-E

"'Are people putting things in linux-next that they don't expect to send to Linus? That seems like the greater problem.

[…]

Why not just use linux-next? […]

[…] have a bot that replies to all PRs with a health check, and Linus can pull it if he thinks it looks good. […]"

lore.kernel.orgRe: linus-next: improving functional testing for to-be-merged pull requests - Kees Cook

@vbabka and @ljs, that "Are people putting things in linux-next that they don't expect to send to Linus? That seems like the greater problem." from @kees reminded me of a question you might be able to help out with:

From a quick look it seems to me that the "mm-unstable" branch is in -next (via "mm-everything"). Does that contain stuff for the next merge window only, or more experimental stuff as well? It looks like the latter to me.

@kernellogger @vbabka @kees what does 'experimental' mean?

mm-unstable is everything that _appears_ to be going to Linus because nobody objected to it yet but some stuff might not end up going because it's got issues.

I'm not sure how you're supposed to differentiate between stuff that's eventually going to get reviewed to the point of not being submitted vs. stuff that'll go?

I think this is a bad take to be honest.

Next _should_ contain stuff we _expect_ will go to Linus, which _is_ all of that.

The issue is that people aren't bloody testing next!

@ljs @kees @vbabka

Well, good points, but fwiw, afaiui only patches that *were* reviewed by one of the official maintainers are supposed to be included in -next. To quote Stephen from lore.kernel.org/linux-next/202

"'You will need to ensure that the patches/commits in your tree/series have
been:
[…]
* reviewed by you (or another maintainer of your subsystem tree),
* successfully unit tested, and
* destined for the current or next Linux merge window."'

lore.kernel.orgRe: update omap branches for linux-next - Stephen Rothwell
@kernellogger @kees @vbabka they are ostensibly reviewed by Andrew.

I mean thanks for trying to make stuff get _less_ tested before rc though...
@kernellogger @kees @vbabka I don't necessarily agree with the process in mm as it stands but this is how it works right now, that is a lack of objection and Andrew not finding major flaws = Andrew in effect approves, and unless it's a relative newcomer or otherwise he has reason not to want it, the series will get merged.

So it's representative of what will be in the next merge window (+ hotfixes not yet upstreamed for rc).

I'd like there to be more of a 'needs a tag from at least someone' rule in mm, but can't control that. It adds workload to people who have to act fast to stop stuff getting pulled in.

If we limited it to mm-stable or something then -next would be _miles_ behind what is going into the next merge window, and you'd also _not_ be stabilising as while not enough people test -next NOBODY tests mm-unstable so it'd become a pretty useless tree.

Again, I think the issue is that more people need to test against -next.

@ljs @kees @vbabka

> I think the issue is that more people need to test against -next.

Avoiding "this might eat my data" fears for the testers is very important detail here to realize that – having patches in there that come from a "unstable" branch is enough to scare people away when it comes to mm or filesystems.

So chancing that name might already help.

@kernellogger @kees @vbabka who is testing unstable unreleased kernel code while also being scared of 'having their data eaten'??

The whole point of -next is 'here is a snapshot of what is probably coming next, please test it'.

rc's might eat your data too, the whole point is for testing to catch this stuff

@ljs @kees @vbabka

eating data is always a risk spectrum (even in stable release there is a risk that it happens) -- and depending on how risky something looks people then decide what they use/test: stable, stable-rc, mainline outside the merge window (that's me currently), mainline all the time, -next.

The less likely the "might eat data" risk is perceived in -next, the more likely people will be willing to help with testing it.

@kernellogger @kees @vbabka I mean some series take weeks and weeks and weeks to get through review.

So what you're saying is - during all of those weeks - we must not have build bots on the series, we must not have anything doing even ostensibly small levels of testing, we just wait until rc and ship it as is and that's 'safer' and will make people 'less scared'.

OK.

@ljs @kees @vbabka

I'm not saying that. Seems I don't got my point across. Whatever, let's please ignore this, discussing it here is unlikely to change anything anyway.

@kernellogger @kees @vbabka but that would be the result of what you're saying basically.

Which is why I object.... based on personal experience.

I'm a little mystified that you would tag me and I take all this time to respond on this issue to you and now you tell me to ignore it, but OK.
Thorsten Leemhuis (acct. 1/4)

@ljs @kees @vbabka

I tagged you as I wanted to better understand the -mm workflow; your answers helped with that. Thx for that.

But from there things went on to different topics and if that workflow is wise or unwise; that's not something I wanted to discuss.

@kernellogger @kees @vbabka lol man if I didn't like you you'd annoy me with this.

But I do like you so, fine fine... but you owe me a beer bro

@ljs @kees @vbabka beer! np! As long as I don't have to drink one. 🥴

@kernellogger @kees @vbabka we can handle the drinking side of it no worries