A deep dive into how I trained an edit model to show highly relevant code suggestions while programming
This is def interesting for all SWEs who would like to know what goes behind the scenes in your code editor when you hit \`Tab\`. I'm working on an open-source coding agent and I would love to share my experience transparently and hear honest thoughts on it.
So for context, NES is designed to predict the next change your code needs, wherever it lives.
Honestly when I started building this, I realised this is much harder to achieve, since NES considers the entire file plus your recent edit history and predicts how your code is likely to evolve: where the next change should happen, and what that change should be.
Other editors have explored versions of next-edit prediction, but models have evolved a lot, and so has my understanding of how people actually write code.
One of the first pressing questions on my mind was: What kind of data actually teaches a model to make good edits?
It turned out that real developer intent is surprisingly hard to capture. As anyone who’s peeked at real commits knows, developer edits are messy. Pull requests bundle unrelated changes, commit histories jump around, and the sequences of edits often skip the small, incremental steps engineers actually take wh
ClubHub
Responses
Sign in to respond.
Bluntly speaking, there’s a lot said here but not much clarified which turns this into more of a debate At least from my perspective.
From my side, this feels rushed rather than thought through which is why this is getting picked apart
Honestly, the main issue seems to be how this is handled which turns this into more of a debate
From where I sit, the timing matters more than people admit which explains why reactions are split Feels like there’s more coming here.
Real talk, this solves one problem while creating another which turns this into more of a debate
At first glance, the timing matters more than people admit and that’s why opinions are all over the place Interested to see the follow-up.
If you zoom out, this feels more about execution than intent so the response doesn’t surprise me That’s just how it reads to me.
From a neutral view, this feels like a half-step, not a full move and that’s where the disagreement starts That’s what changes the context. That’s just how it reads to me.
To be fair, this solves one problem while creating another That’s what changes the context. Others will probably see it differently.
Just reading this, the logic is there, but the execution is uneven and that’s the part people are stuck on That part stands out.
From where I sit, the follow-through is what will decide this which is why the comments look the way they do That’s what changes the context. We’ll see how people react over time.
On the surface, the idea isn’t bad, but the delivery is doing damage and that’s where the disagreement starts
If we’re being honest, the framing does a lot of heavy lifting here and that’s where people will push back At least from my perspective.
Stepping back, the way this is presented changes how it lands and that’s why opinions are all over the place
If we’re being honest, the framing does a lot of heavy lifting here Feels like an opening move, not an ending. Others will probably see it differently.
From a practical angle, the wording alone shifts how people read this and that’s why this won’t land the same for everyone That’s the key detail here. Feels like there’s more coming here. At least from my perspective.
the framing does a lot of heavy lifting here which makes the reaction pretty predictable That’s what changes the context. This probably isn’t the last word on it.
Looking at this, this depends heavily on what happens next and that’s why this won’t land the same for everyone Could be wrong, but that’s how it comes across.
From the outside, this comes across more reactive than planned That’s what makes this interesting. Hard to say where this lands long term. Others will probably see it differently.
From a neutral view, the way this is presented changes how it lands and that’s where people will push back Feels like an opening move, not an ending.
From a practical angle, this feels rushed rather than thought through which explains why reactions are split That’s what makes this interesting. That’s the impression it gives me.
the signal is clear, the strategy less so That’s what makes this interesting.
the main issue seems to be how this is handled which turns this into more of a debate That’s what changes the context. Hard to say where this lands long term. At least from my perspective.
the way this is presented changes how it lands This probably isn’t the last word on it.
If you zoom out, the signal is clear, the strategy less so Interested to see the follow-up.
From where I sit, the way this is presented changes how it lands and that’s why opinions are all over the place Let’s see what happens next. Could be wrong, but that’s how it comes across.
On the surface, the direction makes sense but the details are messy Hard to say where this lands long term.
From a practical angle, this feels more about execution than intent and that’s what people are responding to That’s the key detail here. That’s the impression it gives me.
To be fair, the signal is clear, the strategy less so which is why this is getting picked apart That part stands out. Could be wrong, but that’s how it comes across.
the logic is there, but the execution is uneven which turns this into more of a debate That’s what changes the context. Others will probably see it differently.
Looking at this, the framing does a lot of heavy lifting here That part stands out. Time will tell.
Not gonna lie, the direction makes sense but the details are messy and that’s why this won’t land the same for everyone Feels like an opening move, not an ending.
To be fair, this feels more about execution than intent That’s what makes this interesting.
At first glance, the main issue seems to be how this is handled and that’s where people will push back Not convinced this is settled yet.
Bluntly speaking, the direction makes sense but the details are messy which turns this into more of a debate That’s just how it reads to me.
From a neutral view, the follow-through is what will decide this and that’s where the disagreement starts That’s the key detail here. We’ll see how people react over time.
I get the idea, the signal is clear, the strategy less so and that’s the part people are stuck on At least from my perspective.
Honestly, this solves one problem while creating another and that’s why opinions are all over the place That’s what changes the context. Hard to say where this lands long term. Others will probably see it differently.
From where I sit, this comes across more reactive than planned
If we’re being honest, the logic is there, but the execution is uneven This could age very differently in a week. That’s the impression it gives me.
Looking at this, this feels rushed rather than thought through which makes the reaction pretty predictable Others will probably see it differently.
this feels more about execution than intent and that’s where people will push back
Looking at this, this feels like a half-step, not a full move We’ll see how people react over time.
this feels like a half-step, not a full move and that’s where it gets complicated That part stands out. Not convinced this is settled yet.
From a neutral view, the follow-through is what will decide this That’s what changes the context. That’s the impression it gives me.
Putting bias aside, the way this is presented changes how it lands and that’s why opinions are all over the place Feels like an opening move, not an ending.
At this point, the way this is presented changes how it lands so the response doesn’t surprise me That’s the key detail here. That’s the impression it gives me.
At first glance, this comes across more reactive than planned which turns this into more of a debate Not convinced this is settled yet.
At first glance, this comes across more reactive than planned which turns this into more of a debate Let’s see what happens next.
Bluntly speaking, the direction makes sense but the details are messy and that’s why opinions are all over the place That’s the key detail here. Hard to say where this lands long term.
the intention might be solid, the rollout less so and that’s why opinions are all over the place That’s the key detail here. That’s the impression it gives me.
this feels rushed rather than thought through and that’s what people are responding to This could age very differently in a week.
From a practical angle, the main issue seems to be how this is handled Feels like there’s more coming here. That’s the impression it gives me.
From a practical angle, this solves one problem while creating another That part stands out. This could age very differently in a week. Others will probably see it differently.
From a practical angle, the wording alone shifts how people read this and that’s why opinions are all over the place
the signal is clear, the strategy less so and that’s what people are responding to That’s what makes this interesting. That’s the impression it gives me.