ietf
[Top] [All Lists]

Complaints Against The IESG and The RFC-Editor About Publication of RFC-2188 (ESRO)

2006-03-18 02:22:40

[ This is a repost from 6 Nov 1998.
  In particular the section on:
     o Separate The RFC Publication Service from the IETF/IESG/IAB.
  is relevant to the current:
       STRAW PROPOSAL RFC Editor charter
  thread. ]



              Complaints Against The IESG
                   and The RFC-Editor
           About Publication of RFC-2188 (ESRO)

                      Mohsen Banan
                    mohsen at neda.com

                    November 5, 1998


This is a complaint against the IESG and the RFC-Editor
about publication of RFC-2188 (Efficient Short Remote
Operations - ESRO) as an Informational RFC. A lot went
wrong in the process of publication of RFC-2188.  The
highlights are:


  o The publication of the RFC was delayed for *8 months*
    for no good reason.

  o During the period from the day of submission to the
    day of publication (8 months) there was only one
    technical email exchange related to this RFC and
    the RFC was published exactly as it was submitted
    (plus the IESG note).

  o The IESG was irresponsible and negligent in
    fulfilling its role.

  o The RFC-Editor was negligent in fulfilling its
    role.

  o In practice, the publicized processes and
    procedures for the Informational RFC publication
    were not being followed neither by the IESG and nor
    by the RFC-Editor.

  o In practice, RFC-Editor was reduced to a puppet of
    IESG acting as a glorified secretary and an
    inefficient messenger.

  o The IESG over stepped the scope of its authority
    and displayed an arrogant an dictatorial attitude
    which caused serious delays in the publication of
    the RFC.


I (Mohsen Banan -- mohsen at neda.com) have used very
strong words in the above list to characterize the
problems in this specific case.  Use of those words are
in no way extreme.  Use of ALL of those words are
justified in this message.

The fact that a lot went wrong in the case of
publication of RFC-2188 is known to many.  Steve Coya
and Scott Brander have admitted that there were a
number of problems and have apologized for them.


  Scott Bradner> ... the iesg fucked up and I'm trying to fix the issue ...

  Steve Coya> You DO have a valid complaint, but not with the RFC Editors.

  Scott Bradner> ...  As I said things slipped through
  Scott Bradner> the cracks and I am sorry that happened. ...


I accepted their apologies and after the publication of
RFC-2188 I was going to let this drop.  However, since
then I have seen even more evidence of the IESG being
way out of control and now feel that something needs to
be done.

This note is complete and includes all that is
necessary to allow people to judge for themselves the
validity of my complaints.

My goal is to PRESERVE the so far mostly open
Informational RFC publication process from censorship
by the likes of IESG. We need to find a way to ensure
that what went wrong in this case never happens again.
I am preparing this complaint because I think that it
can help a number of areas which are critical to the
continued success of the Internet.

In the absence of any sort of accountability by the
IESG and the RFC-Editor to anyone, I am hoping that
peer pressure and public embarrassment can be used as
tools to bring the IESG under control and restore the
Information RFC publication process to the open process
that it is supposed to be.

Internet Standards are better than other standards
because we realize that no entity (IETF/IESG/IAB) has
exclusivity on good ideas.  Many (if not most)
good/successful Internet protocols have come from
outside of committees, task forces, groups or boards.
(If you are looking for examples, consider the web.)

Fair and equitable access to the RFC publication
service is fundamental to the success and growth of the
Internet.  Good protocols (as well as bad protocols)
coming from outside of the IETF should have access to
the RFC publication service, so that they can be used
and even sometimes compete with IETF/IESG work.  The
network and the market place ultimately decides the
winners and the loosers.

Now, my experience with the publication of RFC-2188 has
convinced me that:


  o the IESG frequently abuses its authority and in
    fact is allowed to delay the publication of RFCs
    indefinitely and even engage in censorship of
    material that it just does not like or that it does
    not understand.

  o both the IESG and the RFC-Editor operate with an
    "authority" oriented attitude as opposed to a
    "responsibility" oriented attitude.

  o in practice there are not adequate checks and
    balances in the process to guard against mistakes
    by the IESG or the RFC-Editor.


If any of the above is true we have a problem.
Unfortunately, this note clearly demonstrates that all
of the above were true in the case of RFC-2188.  I am
also now convinced that the problems in the case of
RFC-2188 were not isolated to that case alone.  There
is a serious problem.

The rest of this note substantiates my claims about the
problem.  Because this deals with a concrete and
specific case, because it deals with history of what
has already happened, because it is a complete case, I
hope that this note can be used to identify and fix the
serious problems that exist.

Because this note is documentation of a complete case,
it is somewhat lengthy.

This note is organized in 4 sections.


 1. A summary analysis of the publication process for
    non IETF Informational RFCs both in "theory" and
    in "practice".

 2. Recommendations For Improvements.

 3. Summary of ALL The Communications Records from the
    date of submission to the date of publication.

    In this section, I substantiate all of the above
    mentioned claims and problems.

 4. A Message Digest for ALL email exchanges from the
    date of submission to the date of publication.


Info RFC Publication In Theory and in Practice
==============================================

In theory, "The Internet Standards Process" (BCP-9,
RFC-2026) defines at a high level a very reasonable
process for publication of non IETF protocols as
Informational RFCs.  The problem is that in practice
that process is not followed.  The IESG is allowed to
indefinitely delay the publication of RFCs or simply
reject them because the IESG does not get them or
because the IESG does not like them.


Info RFC Publication In Theory
------------------------------

The highlights of the process of publication of non
IETF protocols as Informational RFCs (taken from
sections 4.2.2 and 4.2.3 of RFC-2026) are:


  o Informational designation does not represent an
    Internet recommendation of any sort.

  o Publication of Informational RFCs is supposed to be
    "timely".

  o The RFC-Editor (and NOT the IESG) is responsible
    for determining suitability for publication based
    on:

    -- Relevance to Internet activity

    -- Meets the technical standard for RFCs

    -- Meets the editorial standard for RFCs

  o The RFC-Editor refers the document to the IESG for
    review which is to be in a timely manner.  The
    scope of IESG's review of the document is to
    identify areas of overlap with on going or future
    IETF activities.


    -- The IESG can recommend that the document be
       brought in the IETF.

    -- The IESG can determine that the document
       conflicts with or is inimical to an established
       IETF effort.

       In that case the document may still be published
       as an Informational RFC with an IESG disclaimer.


This process is very reasonable.  Irrelevant or
sub-standard specifications (such as Internet Porn
Protocol - IPP) will be stoped by the RFC-Editor.
Reasonable protocols get a chance to be published in a
timely manner.  The IESG is not allowed to censor
anything in favor of its own activities or opinions.


Practice
--------

In practice the role of the RFC Editor for documents
coming from outside of the IETF/IESG/IAB has been
reduced to that of a glorified clerk of the IESG. In
other words in practice the IESG has already expanded
its limited role as a conflict detector to a
commentator and the authorative reviewer and the final
decision maker.

In practice, the RFC Editor is not in charge the IESG
is.

Neither the IESG, nor the RFC Editor have any respect
for the requirement of "timely" processing of the non
IETF Informational RFCs.


Un-Answered Questions
---------------------

During the process of publication of RFC-2188 when it
became obvious that the process being followed is not
that of BCP-9.  I started asking the following
questions.  These questions were asked a number of
times from the RFC-Editor and the IESG. They have never
responded to any of them.  They remain unanswered.


  o What process is the RFC Editor following for the
    publication of Informational RFCs (since it clearly
    is not the process define in BCP-9)?

  o What do "reasonable period of time" and "timely"
    mean to the RFC Editor and the IESG?

  o What does the IESG think the scope and purpose of
    its review of the non IETF RFCs are?

  o What is the RFC Editor expected to do when the IESG
    does not review the document in a reasonable period
    of time?

  o Who do the RFC Editor and the IESG find themselves
    accountable to?

  o What should the Author of an RFC do when its
    repeated questions and concerns are simply ignored?


In light of everything that happened in the case of
RFC-2188, I consider all of these questions valid and
legitimate.  These questions have been asked many times
to no avail.  They remain unanswered.


Recommendations For Improvements
================================

Because of the RFC-2188 experience and other
interactions that I have had with the IESG and the
RFC-Editor, I have some suggestions for improving the
non IETF Informational RFC publication process and
practice.


  o Recognize what IESG really is and what its role is
    supposed to be.  Limit the IESG's role to what it
    is supposed to be.

    The IESG is a hand-full of volunteer engineers with
    a fancy group name.  Based on my interactions with
    them, I have concluded that they hardly reach the
    "average" level of competence in my book -- both
    in their technical and in their management
    abilities.  The IESG often has little relevant
    experience and knowledge in the specialized subject
    matter of the RFCs that it needs to review.

  Instead of functioning in its limited co-ordination
  and conflict detector role as defined in section
  4.2.3, in practice the IESG has already expanded
  its own role and has assumed ultimate authority
  over publication/non-publication of non IETF
  originated Informational RFCs.

  The IESG should not be permitted to engage in
  censorship or delay of publication of work coming
  from outside of IETF because they just don't like
  it, because they don't understand it, because they
  think that it may be competing with IETF/IESG work
  or because they think that it may be bad for the
  Internet.

  Based on the case of RFC-2188, I have concluded
  that the IESG is out of control and irresponsible.
  It needs to be checked and managed.

o Strengthen the RFC-Editor's Role.

  In practice the role of the RFC Editor for
  documents coming from outside of the IETF/IESG/IAB
  has been reduced to that of a glorified clerk of
  the IESG.

  If and when the IESG does not complete its review
  of the refered documents, it is the RESPONSIBILITY
  of the RFC Editor to go ahead and publish the
  document.  The RFC Editor should not permit the
  IESG to introduce long delays in the publication of
  documents.

  The RFC Editor should ensure that the IESG note
  going into an Informational RFC is in fact
  reasonable and correct and provide the author an
  opportunity to see the IESG note prior to
  publication.

  The RFC Publication Service can benefit from
  additional resources.  I am pretty sure that
  getting funding for such a critical service is not
  going to be difficult if we look at it the right
  way.

o Ensure that the procedures of BCP-9 are followed in
  practice.

  The spirit of sections 4.2.2 and 4.2.3 of BCP-9 is
  just right.

  However, the case of RFC-2188 clearly shows that in
  practice the procedures of BCP-9 are not being
  followed.

  We need to find a way to make sure that what BCP-9
  says is in fact what happens.

o Introduce more accountability, structure and order
  to the RFC publication service.

  Tighten BCP-9 to be more clear about minimum
  technical requirements for RFCs.  Introduce an
  appeals process for when a document is rejected.
  More clearly define "timely"...

  Provide mechanisms that safeguard against mistakes
  and negligence by the IESG or the RFC Editor.

  Define specifically, what is supposed to happen
  when the IESG does not complete its limited review
  in a timely manner.

  Re-orient everything towards responsibilities of
  the publication service providers instead of their
  authorities.

o Separate The RFC Publication Service from the
  IETF/IESG/IAB.

  The RFC Editor task is primarily a Publication
  Service.  The IETF/IESG/IAB is JUST one of the
  users/customers of the the RFC Publication Service.

  There has been talk of putting the RFC Publication
  Service under management and funding of
  IETF/IESG/IAB/ISOC. That would be totally wrong.

  There is an obvious inherent problem with allowing
  a common Publication Service to be managed and
  funded by one of its users.  The problem is that
  IETF/IESG/IAB is likely to claim control over the
  entire RFC Publication Service and delay the
  publication or exclusion of protocols coming from
  outside of it and suppress standards competition
  even more.

  Clear separation of powers is a good thing.  It is
  a good way of introducing accountability and checks
  and balances.

  A powerful and independent RFC Editor role which
  would oversee a fair and equitable RFC Publication
  service is ESSENTIAL for the Internet.

  In practice, the RFC Editor role has been weakened
  over the years.  We need to strengthen it.




Limiting IETF/IESG/IAB's role in the RFC Publication Process
------------------------------------------------------------

Let's look at what needs to happen in the bigger
picture.  Standardization process iterates through 4
essentially distinct steps.


1) Development of the Protocol. IETF/IESG are just one
    of the entities developing protocols.  Many good
    protocols are developed by non-standards related
    entities.

2) Publication of the Protocol. A wide open, quick and
    fair publication service is needed to allow for
    anyone who wants to build or play with protocols to
    have access to its specification.  The fundamental
    characteristics of the RFC Publication Service for
    the most part have been working real well.  Any
    relevant protocol coming from essentially anywhere
    which meets a minimum technical and/or editorial
    standard should have speedy access to the RFC
    Publication Service.

3) Use of the Protocol. If it is anything useful and is
    done right, it will be used.  How it gets used is
    very important and unpredictable.

4) Blessing of the Protocol. Some entity (e.g.,
    IETF/IESG/IAB) blesses the protocol by putting some
    label on it.  Although necessary, this function is
    mostly ceremonial.  The real legitimacy comes from
    usage and the market place.


Without a question, IETF/IESG/IAB should play some role
in step (1).

Without a question, IETF/IESG/IAB need to focus on step
(4).

But, I am saying that putting step (2) under management
and funding of IETF/IESG/IAB/ISOC is WRONG. Because it
has the potential of further suppressing the results of
step (1) coming from outside of IETF/IESG.

Note, that I don't have a problem with the spirit of
the relationship between The RFC-Editor and
IETF/IESG/IAB/ISOC as described in BCP-9.  My point is
that by making step (2) completely and truly
independent of management and funding by
IETF/IESG/IAB/ISOC, we will bring about the necessary
checks and balances that are needed for a healthy
overall process which needs to even encourage
competition in step (1).


Summary Of The Communication Records in Chronological Order
===========================================================

All the communication between the Authors, the RFC
Editor and the IESG were in the form of email
exchanges.  There were no phone calls or face-to-face
conversations of any sort.

The email exchanges are factually summarized below and
reference to the actual email is included.


Jan 11, 97 -- Authors To RFC-Editor: Mark Taylor (then
    of AT&T) submitted the ESRO protocol for
    publication as an Informational RFC.
    (Message-Id: <32D7FFCA at wddmssmtp.nwest.airdata.com>)

Jan 15, 97 -- Mohsen BANAN To RFC-Editor: Shortly after
    that (on 1/15/97) I incorporated IANA's port
    assignment for the ESRO protocol and resubmitted it
    to the RFC-Editor.
    (Message-Id: <199701160714.XAA29795 at jamshid.neda.com>)

Jan 23, 97 -- RFC-Editor To Authors: On January 23rd,
    the RFC editor acknowledged receipt and placed it
    in the publication queue and forwarded it to the
    IESG/IETF for their review.
    (Message-Id:  <199701231743.AA10376 at zen.isi.edu>)

Jan 29, 97 -- RFC-Editor To IETF-Announce: The ESRO
    protocol was put in the internet drafts directory
    on January 29th.
    (Message-Id:  <9701300942.aa02647 at ietf.org>)

March 31, 97 -- Mohsen BANAN To RFC-Editor: On March
    31st I checked on the current status of this RFC
    and expressed our desire to see it published soon.
    (Message-Id: <199704010128.RAA26066 at jamshid.neda.com>)

April 3, 97 -- RFC-Editor To Authors: On April 3th we
    were told that The IESG had requested that the ESRO
    document not be published at this time and that
    they would be in contact with us after their
    meeting that coming week in Memphis.
    (Message-Id: <199704032357.AA17887 at zephyr.isi.edu>)

April 3, 97 -- Mohsen BANAN To RFC-Editor: I
    immediately replied requesting an explanation of
    this delay and the name of the relevant IESG
    contact person.  I again offered to discuss and
    respond to questions/comments regarding the ESRO
    protocol.
    (Message-Id: <199704040100.RAA07041 at jamshid.neda.com>

    At that time our only contact point was the RFC
    Editor.  The Editor neglected to reply to that
    message.  Those questions remain unanswered even
    today.  Had the RFC Editor responded to that
    message in April, we would have saved a lot of
    time.  The above instance alone justifies my fair
    use of the word "negligently" with respect to the
    RFC Editor.

July 28, 97 -- Mohsen BANAN To RFC-Editor: Having not
    heard from the RFC Editor since April 3rd (nearly 4
    months), I prepared a detailed message which
    explained that the RFC Editor and IESG's treatment
    of this RFC is totally unreasonable.
    (Message-Id: <199707290658.XAA28413 at jamshid.neda.com>)

July 28, 97 -- RFC-Editor To Steve Coya: The RFC Editor
    (Mary Kennedy) forwarded my message to Steve Coya.
    (Message-Id: <199707291539.AA11953 at zephyr.isi.edu>)


August 4, 97 -- Mohsen BANAN To RFC-Editor and Steve Coya:
    At that time (6 months after initial submission and
    a week after my previous detailed request for
    explanation) Steve Coya and the IESG had still not
    responded to ANY of our messages and requests.
    Our repeated requests for an explanation kept being
    ignored.  The IESG's actions up to that point
    combined with their dictatorial attitude and
    arrogance at that point, at a minimum, justifies my
    use of the words "negligent" and
    "irresponsible".
    (Message-Id: <199708041804.LAA07856 at rostam.neda.com>)

August 4, 97 -- Steve Coya to Authors: After more than
    6 months, this is the first time that anyone at the
    IESG has communicated with us.  In that message,
    Steve Coya tells us that the IESG requested that
    the document not be published.  This is a clear
    violation of the procedures of BCP-9.  No where in
    RFC 2026 is the IESG given the authority to stop
    the publication of a non IETF Informational RFC.
    Now, add to that the level of arrogance that says
    IESG can ignore the Authors' inquiries for 6 months
    and provide no explanation what-so-ever to why IESG
    has prevented the publication of the RFC. Then add
    to it, that later it becomes clear that Steve Coya
    was just wrong.
    (Message-ID: <Pine.WNT.3.96.970804141858.-301315F-100000 at 
dell06.cnri.reston.va.us>)

August 4, 97 -- Scott Bradner to Authors: Scott Bradner
    tells us that it appears that it might be worth
    while to issue an IETF last call on it and advance
    it as a proposed standard!  Obviously that was
    contradictory to what Steve Coya had said earlier
    that same day.
    (Message-Id: <199708041935.PAA05510 at newdev.harvard.edu>)

August 4, 97 -- Mohsen BANAN To Scott Bradner: I
    re-iterate the sense of urgency here.

August 6, 97 -- Mohsen BANAN To Scott Bradner: I check
    on status of progress and mention that a lot has
    gone wrong so far and that is why we are impatient.

August 6, 97 -- Scott Bradner to Authors: Scott Bradner
    tells me that no abuse should be directed towards
    the RFC Editor.
    (Message-Id: <199708061908.PAA09003 at newdev.harvard.edu>)

August 7, 97 -- Mohsen BANAN To Scott Bradner: I
    explain that my use of the words "irresponsibly and
    negligently" do not constitute abuse towards the
    RFC Editor.  And I justify them again.
    (Message-Id: <199708071844.LAA12806 at rostam.neda.com>)

August 7, 97 -- Scott Bradner to Mohsen BANAN: Scott
    Bradner in a message only to me suggests that if I
    can't see that the tone of my messages are abusive,
    I should talk to a friend.
    (Message-Id:     <199708071924.PAA10978 at newdev.harvard.edu>)

    I do not consider this a personal or private
    message.  On a personal level, I wish to have no
    relationship what-so-ever with anyone on the IESG.
    I simply want them to fulfill their particular
    responsibilities with respect to facilitation of
    publication of my Informational RFCs.

    The key point not to be missed here is that if the
    IESG has been doing its job, we would not be
    discussing the tone of my messages.

    I did not dignify that message with a response.

August 7, 97 -- Scott Bradner to Authors: Scott Bradner
    tell us that ex-transport co-AD feels that this ID
    represents a significant technical contribution and
    feels that it should be advanced on the IETF
    standards track.
    (Message-Id: <199708071943.PAA11036 at newdev.harvard.edu>)

    Scott Bradner asks us to choose between the
    Informational RFC publication route or the Proposed
    Standard route.

August 8, 97 -- Mohsen BANAN To Scott Bradner: The
    Authors choose the Informational RFC route because
    the urgency for publication in this case outweighs
    our interest in getting this document on the
    standards track.
    (Message-Id: <199708081853.LAA14067 at rostam.neda.com>)

August 8, 97 -- Scott Bradner to Authors: Scott Bradner
    asks:  What is causing this feeling of urgency?
    (Message-Id: <199708082046.QAA01197 at newdev.harvard.edu>)

August 8, 97 -- Mohsen BANAN To Scott Bradner: I
    explain.
    (Message-Id: <199708082219.PAA14258 at rostam.neda.com>)

August 17, 97 -- Scott Bradner to Authors: Scott
    Bradner informs us of his recommendation of ESRO
    for publication and that he hopes we will put this
    specification on standards track when it is ready.
    (Message-Id:  <199708180051.UAA08685 at newdev.harvard.edu>)

August 17, 97 -- Mohsen BANAN To Scott Bradner: I
    thanked him and said that I will.
    (Message-Id: <199708180434.VAA26606 at rostam.neda.com>)

August 18, 97 -- Scott Bradner to Authors: Scott
    Bradner forwards a technical comment from Harald
    Alvestrand to the Authors.  This is the *ONLY*
    technical comment that we ever received from the
    IESG or the RFC Editor.
    (Message-Id: <199708181217.IAA09055 at newdev.harvard.edu>)

August 18, 97 -- Mohsen BANAN To Scott Bradner: I
    respond to that technical comment.
    (Message-Id: <199708181850.LAA27366 at rostam.neda.com>)

August 28, 97 -- Mohsen BANAN To Scott Bradner: I
    explicitly ask that he keeps me posted on his
    communications with the RFC Editor related to this
    RFC.
    (Message-Id: <199708282146.OAA11605 at rostam.neda.com>)

    If there was to be an IESG Note, I wanted to have a
    chance and see it before publication.

August 28, 97 -- Scott Bradner to Authors: Scott
    Bradner informs us that he publication was approved
    by the IESG. But does not mention anything about
    the IESG note.
    (Message-Id: <199708282229.SAA23730 at newdev.harvard.edu>)

September 9, 97 -- Mohsen BANAN To Scott Bradner: I ask
    about the expected publication date.

September 9, 97 -- RFC Editor to IETF-Announce: The RFC
    Editor announces publication of RFC-2188.


The text of RFC-2188 is materially same as what we
submitted to the RFC Editor on Jan 15, 1997, with
the exception of the IESG note.


To our surprise we discovered the following IESG
note in our RFC.

---
IESG Note

   This protocol has not had the benefit of IETF Working Group review,
   but a cursory examination reveals several issues which may be
   significant issues for scalability.  A site considering deployment
   should conduct a careful analysis to ensure they understand the
   potential impacts.
---

A few key points about this IESG Note:

 o The Authors were never given a chance to know
   about any of the issues that the note implies,
   even-though I had explicitly asked to be
   informed of communications related to this RFC.

 o After delaying the publication for 8 months, why
   is the IESG Note based on "a cursory
   examination".

 o If that IESG Note is true, then why were the
   Authors not given a chance to know about them
   and fix them?

 o If that IESG Note is true, then why did the Area
   Director want to put it on the Standards Track
   and issue a Last Call for it?

 o The IESG note is so vague that up until recently
   I thought that it was about the wrong perception
   of limitations of Service Access Points -- which
   was the ONLY technical issue that was ever
   discussed with the Authors.  How can the IESG
   expect that such an unsubstantiated vague
   comment be of use to anyone?  The best I can
   gather, this appears to have just been a "power
   trip" by an out of control IESG.

 o I am not saying that RFC-2188 is perfect and
   that no IESG note should have ever been put in
   it.  I am saying that the IESG note that was put
   in there was done the wrong way and is of little
   use, if any.


If any of my employees were to ever be responsible for
a small fraction of the types of arrogance, negligence
and mistakes that were commited during the process of
publication of RFC-2188, I would fire or demote them
immediately.

But, the IESG is a collection of volunteers which
answers to no one.

Unless we can find a way to deal with problems like
this and fix them, I am afraid that arrogance,
negligence, irresponsibility and incompetence will be
institutionalized inside of the IESG.


Complete Message Digest
=======================

ALL of the messages related to this case that I originated or received
starting from the time of initial submission up until the time of
publication of the RFC are included as 30 email messages below.  Other
than deleting the attachments of the original specification and
deleting duplicate message digests, these messages have not been
edited in any way.

My interactions with individulas at the IESG and the
RFC Editor were in the context of them functioning in
their roles as Service Providers. I consider none of
these email messages private, personal or confidential.

------- start of digest (30 messages) (RFC 934 encapsulation) -------
See http://www.esro.org/

_______________________________________________
Ietf mailing list
Ietf(_at_)ietf(_dot_)org
https://www1.ietf.org/mailman/listinfo/ietf