ietf
[Top] [All Lists]

Why have we gotten away from running code?

2005-08-06 16:08:09
I notice that we have stopped being interested in running code.

I think that is to our community's detriment.

If two groups are arguing with one another, and one has implemented code and
the other has not, I think we would give great weight to the running code.
I don't see that happening.  This happened in a session during this meeting
where I was present.  Running code was not considered significant in the
discussion; it was not even mentioned as a criterion in deciding the issue.

Probably more importantly, I think we should be VERY suspicious of new,
complex specifications before we have running code.  We are very clearly NOT
doing this.  We are willing to publish a proposed standard for an entirely
new protocol that has very significant complexity, where there are people
openly skeptical that it will work at all, with nothing but some sketchy
simulations and a (admittedly well reviewed) draft.  We are routinely
publishing complex protocols and significant changes/additions without even
simulations.

Our rules permit us to do such things.  We should rarely choose to.  We
don't know what we are getting into until we write code.  We don't know how
hard it is to implement, we don't know what works and what doesn't.

Perhaps there are a large number of you out there that are able to claim
reasonably complex things work based on reading a document and looking at
simulations.  I am not.  My experience is that getting something to actually
do what you want it to do is very illuminating.

I wonder if we should change our bias towards bestowing Experimental status
on drafts that ask to be published as RFCs without running code.

Clearly, there are specifications where the complexity is low, and we have
enough experience with the subject that we can be reasonably sure it works
without running code.  We should be able to bring such ideas out at Proposed
Standard.  Good judgment is always required to choose which side of a line a
particular draft falls on.  I assert we have pushed the line away from
running code quite too far.

We still do operate with rough consensus.  We ought to return to having
running code.

Brian



_______________________________________________
Ietf mailing list
Ietf(_at_)ietf(_dot_)org
https://www1.ietf.org/mailman/listinfo/ietf