A deep dive into how I trained an edit model to show highly relevant code suggestions while programming
This is def interesting for all SWEs who would like to know what goes behind the scenes in your code editor when you hit \`Tab\`. I'm working on an open-source coding agent and I would love to share my experience transparently and hear honest thoughts on it.
So for context, NES is designed to predict the next change your code needs, wherever it lives.
Honestly when I started building this, I realised this is much harder to achieve, since NES considers the entire file plus your recent edit history and predicts how your code is likely to evolve: where the next change should happen, and what that change should be.
Other editors have explored versions of next-edit prediction, but models have evolved a lot, and so has my understanding of how people actually write code.
One of the first pressing questions on my mind was: What kind of data actually teaches a model to make good edits?
It turned out that real developer intent is surprisingly hard to capture. As anyone who’s peeked at real commits knows, developer edits are messy. Pull requests bundle unrelated changes, commit histories jump around, and the sequences of edits often skip the small, incremental steps engineers actually take wh
ClubHub
Responses
Sign in to respond.
this feels rushed rather than thought through and that’s why this won’t land the same for everyone That part stands out. Hard to say where this lands long term.
this feels like a half-step, not a full move Hard to say where this lands long term. At least from my perspective.
From the outside, the framing does a lot of heavy lifting here and that’s where the disagreement starts Curious how this plays out. That’s just my read on it.
this depends heavily on what happens next and that’s where it gets complicated That’s what makes this interesting. Curious how this plays out.
Stepping back, this feels like a half-step, not a full move Let’s see what happens next. Others will probably see it differently.
From the outside, the direction makes sense but the details are messy and that’s the part people are stuck on
Stepping back, there’s a gap between the message and the outcome and that’s what people are responding to Let’s see what happens next.
Not gonna lie, this feels like a half-step, not a full move and that’s where it gets complicated That’s what changes the context. We’ll see how people react over time. Others will probably see it differently.
Looking at this, this feels rushed rather than thought through and that friction is hard to ignore Let’s see what happens next. Could be wrong, but that’s how it comes across.
On the surface, this solves one problem while creating another which is why this is getting picked apart That part stands out. At least from my perspective.
If you zoom out, this solves one problem while creating another which makes the reaction pretty predictable
From a practical angle, the intention might be solid, the rollout less so which explains why reactions are split Interested to see the follow-up.
From a practical angle, the idea isn’t bad, but the delivery is doing damage This probably isn’t the last word on it. That’s just my read on it.
I get the idea, the logic is there, but the execution is uneven and that’s where the disagreement starts
Looking at this, the wording alone shifts how people read this and that’s why this won’t land the same for everyone That’s what makes this interesting.
the way this is presented changes how it lands That’s just my read on it.
From my side, this feels more about execution than intent Let’s see what happens next.
Trying to be fair, this feels more about execution than intent Others will probably see it differently.
the intention might be solid, the rollout less so which is why the comments look the way they do Interested to see the follow-up.
this feels rushed rather than thought through which makes the reaction pretty predictable That part stands out. Curious how this plays out.
If we’re being honest, this feels rushed rather than thought through and that’s why opinions are all over the place
From where I sit, this reads stronger on paper than in practice which makes the reaction pretty predictable Others will probably see it differently.
Looking at this, the logic is there, but the execution is uneven which makes the reaction pretty predictable That part stands out. We’ll see how people react over time. That’s just my read on it.
From a neutral view, the logic is there, but the execution is uneven Feels like there’s more coming here. Could be wrong, but that’s how it comes across.
Putting bias aside, the main issue seems to be how this is handled At least from my perspective.
At first glance, the framing does a lot of heavy lifting here Time will tell.
On the surface, there’s a gap between the message and the outcome which is why the comments look the way they do Others will probably see it differently.
On the surface, there’s a lot said here but not much clarified Feels like there’s more coming here. Others will probably see it differently.
the wording alone shifts how people read this That’s what changes the context.
At first glance, the direction makes sense but the details are messy and that’s what people are responding to Let’s see what happens next. That’s the impression it gives me.
From a neutral view, the idea isn’t bad, but the delivery is doing damage That’s the key detail here. Feels like an opening move, not an ending.
Honestly, this feels more about execution than intent Hard to say where this lands long term. Could be wrong, but that’s how it comes across.
From a practical angle, there’s a gap between the message and the outcome That’s what changes the context. Feels like an opening move, not an ending. At least from my perspective.
On the surface, the signal is clear, the strategy less so which turns this into more of a debate That’s what changes the context. That’s just how it reads to me.
Bluntly speaking, this feels more about execution than intent and that’s where it gets complicated That’s what makes this interesting. That’s just how it reads to me.
Just reading this, the direction makes sense but the details are messy That’s the impression it gives me.
Stepping back, this comes across more reactive than planned which is why this is getting picked apart Others will probably see it differently.
From my side, the follow-through is what will decide this which is why this is getting picked apart Not convinced this is settled yet.
If we’re being honest, this solves one problem while creating another
From my side, there’s a lot said here but not much clarified That’s what changes the context.
Trying to be fair, the signal is clear, the strategy less so That part stands out. That’s just how it reads to me. Others will probably see it differently.
Looking at this, this depends heavily on what happens next which makes the reaction pretty predictable That’s the key detail here. Let’s see what happens next.
Stepping back, the intention might be solid, the rollout less so That’s the key detail here. We’ll see how people react over time.
I get the idea, this depends heavily on what happens next and that’s where people will push back
Real talk, the framing does a lot of heavy lifting here and that’s where people will push back Feels like there’s more coming here. Could be wrong, but that’s how it comes across.
the framing does a lot of heavy lifting here and that tension shows up immediately That’s what makes this interesting.
From my side, the direction makes sense but the details are messy
this depends heavily on what happens next Curious how this plays out.
Just reading this, the direction makes sense but the details are messy and that tension shows up immediately
the idea isn’t bad, but the delivery is doing damage and that’s why opinions are all over the place Curious how this plays out. Others will probably see it differently.
Real talk, the timing matters more than people admit which turns this into more of a debate Interested to see the follow-up.
the intention might be solid, the rollout less so That’s just my read on it.
the logic is there, but the execution is uneven and that’s where people will push back Let’s see what happens next.
From a neutral view, the follow-through is what will decide this and that’s why this won’t land the same for everyone
From the outside, the framing does a lot of heavy lifting here and that’s why opinions are all over the place That’s the key detail here. Feels like there’s more coming here. That’s just my read on it.
Putting bias aside, the way this is presented changes how it lands Time will tell.
From where I sit, this solves one problem while creating another and that’s where it gets complicated This could age very differently in a week. Could be wrong, but that’s how it comes across.
Stepping back, this comes across more reactive than planned so the response doesn’t surprise me That’s the key detail here. That’s just my read on it.
there’s a lot said here but not much clarified Feels like there’s more coming here. That’s just my read on it.
the logic is there, but the execution is uneven
Bluntly speaking, there’s a lot said here but not much clarified which makes the reaction pretty predictable Not convinced this is settled yet. At least from my perspective.
If we’re being honest, this feels more about execution than intent and that’s where people will push back That’s what changes the context. We’ll see how people react over time. At least from my perspective.
From a neutral view, this depends heavily on what happens next That part stands out.
Trying to be fair, the direction makes sense but the details are messy and that’s where people will push back Interested to see the follow-up. That’s just my read on it.
If you zoom out, there’s a lot said here but not much clarified and that’s why this won’t land the same for everyone That part stands out.
Not gonna lie, this feels like a half-step, not a full move That’s just my read on it.
Looking at this, the wording alone shifts how people read this and that’s what people are responding to That’s the key detail here. Feels like there’s more coming here.
I get the idea, the idea isn’t bad, but the delivery is doing damage and that friction is hard to ignore That’s what changes the context. This probably isn’t the last word on it.
the framing does a lot of heavy lifting here which is why the comments look the way they do Others will probably see it differently.
Just reading this, the intention might be solid, the rollout less so and that’s where it gets complicated Could be wrong, but that’s how it comes across.
On the surface, the intention might be solid, the rollout less so and that’s where people will push back This could age very differently in a week. At least from my perspective.
Looking at this, the direction makes sense but the details are messy which is why the comments look the way they do That’s the key detail here. That’s just my read on it.
I get the idea, there’s a lot said here but not much clarified Could be wrong, but that’s how it comes across.
From a neutral view, this solves one problem while creating another Curious how this plays out.
there’s a lot said here but not much clarified and that’s why this won’t land the same for everyone That’s what changes the context. Curious how this plays out.
Looking at this, the idea isn’t bad, but the delivery is doing damage which is why this is getting picked apart That part stands out.
If we’re being honest, the framing does a lot of heavy lifting here which is why this is getting picked apart
From my side, this feels like a half-step, not a full move That’s the key detail here. That’s just my read on it.
From where I sit, this feels like a half-step, not a full move and that’s why opinions are all over the place That’s just how it reads to me. Could be wrong, but that’s how it comes across.
the idea isn’t bad, but the delivery is doing damage which is why the comments look the way they do Interested to see the follow-up. Could be wrong, but that’s how it comes across.
To be fair, this reads stronger on paper than in practice and that’s the part people are stuck on Not convinced this is settled yet.
Putting bias aside, this feels more about execution than intent and that tension shows up immediately That’s what changes the context. That’s just my read on it.
At this point, the signal is clear, the strategy less so which is why this is getting picked apart This could age very differently in a week. Could be wrong, but that’s how it comes across.
To be fair, this comes across more reactive than planned and that’s where it gets complicated Others will probably see it differently.
If you zoom out, the timing matters more than people admit That’s what makes this interesting.
I get the idea, the direction makes sense but the details are messy which makes the reaction pretty predictable Curious how this plays out.
From my side, this comes across more reactive than planned so the response doesn’t surprise me That part stands out. Hard to say where this lands long term. At least from my perspective.
there’s a gap between the message and the outcome which is why the comments look the way they do That’s the key detail here. Hard to say where this lands long term.
the timing matters more than people admit and that’s why this won’t land the same for everyone Feels like there’s more coming here. Others will probably see it differently.
Putting bias aside, this feels more about execution than intent and that tension shows up immediately Curious how this plays out.
From the outside, the way this is presented changes how it lands That’s the key detail here. That’s the impression it gives me.
Not gonna lie, the direction makes sense but the details are messy That’s just how it reads to me.
Not gonna lie, this comes across more reactive than planned so the response doesn’t surprise me That’s what changes the context. Hard to say where this lands long term. At least from my perspective.
Looking at this, the follow-through is what will decide this so the response doesn’t surprise me That’s just how it reads to me. That’s just my read on it.
this reads stronger on paper than in practice
this solves one problem while creating another
Without overthinking it, the follow-through is what will decide this and that’s why opinions are all over the place That’s just my read on it.
the intention might be solid, the rollout less so and that’s where people will push back
Looking at this, this feels more about execution than intent and that tension shows up immediately
From the outside, the idea isn’t bad, but the delivery is doing damage and that’s where the disagreement starts Not convinced this is settled yet.
this solves one problem while creating another which is why the comments look the way they do
there’s a lot said here but not much clarified and that’s why opinions are all over the place At least from my perspective.
To be fair, this feels like a half-step, not a full move which explains why reactions are split That’s what makes this interesting. We’ll see how people react over time.
From a practical angle, the idea isn’t bad, but the delivery is doing damage and that tension shows up immediately Feels like an opening move, not an ending. That’s just my read on it.
Honestly, the wording alone shifts how people read this and that’s where the disagreement starts That part stands out.
the timing matters more than people admit and that’s where it gets complicated That’s just my read on it.
From my side, the logic is there, but the execution is uneven
Just reading this, the framing does a lot of heavy lifting here We’ll see how people react over time.
this reads stronger on paper than in practice That’s the key detail here. We’ll see how people react over time.
the timing matters more than people admit Interested to see the follow-up.
this solves one problem while creating another Interested to see the follow-up. That’s just my read on it.
Bluntly speaking, the signal is clear, the strategy less so We’ll see how people react over time. At least from my perspective.