Paul Davis
 Intranet --> Personal Work Spaces --> Paul Davis --> Assessment of CIT Services for College Intranet  
   

Assessment of CIT Services for College Intranet

 

I wrote the following email to Mark Mara of CIT in order to frame a discussion and to present my perspective. I wrote almost all of it in a four hour sitting before work so it may contains factual errors. (Correcting these misunderstandings on my part, was, after all, part of the reason I wanted to talk with Mark.) As I learn more, I will try to correct and update this document as I can, at least through our intranet discovery phase.

 

-Paul

 


 

Date: Tue, 25 Jan 2005 07:45:16 -0500
To: Mark A Mara <mam1@cornell.edu>
From: Paul Davis <prd9@cornell.edu>
Subject: Assessment of CIT services for college intranet
Cc: cel3@cornell.edu (Cathy Long)
Bcc: paul.davis@gmail.com

Mark, In preparation of our meeting tomorrow I've written up my current assessment of CIT's services as they apply to our intranet project. I'd like to use it as a discussion starter for tomorrow. Since I hear you are particularly involved in the workflow management part of this puzzle, I'd like to start the discussion there. I am also very interested in discussing IT governance in relation to this effort.

-Paul

Below are three sections. First an executive summary, then a more in-depth evaluation of CIT's technology offerings that are applicable to our intranet project and finally some promising IT governance models I've seen in relation to two CIT projects.

Executive Summary
Engineering is planning to develop a college wide intranet with roll out of the first phase anticipated this summer. In this process we have identified the following 9 technologies we would eventually like to use, CIT offers, or is considering offering, services for 8 of them:
  • Single sign-on authentication (CU Web Auth / Kerberos)
  • Web content management (CommonSpot)
  • Data delivery and reporting tools (Brio)
  • Portal infrastructure (uPortal)
  • Directory services (LDAP directory, Authorization directory)
  • Web collaboration tools & project workspaces (not currently offered by CIT)
  • Work flow management (Web Methods, OneStart, & DFA's MetaStorm)
  • Document management (Fedora, Hein On-Line)
  • Course management (BlackBoard, Sekia)
In our evaluation of CIT's offerings, we have found only two that meet our business needs well enough that we will include them in our first phase. They are CommonSpot and CUWebAuth.

In response to this situation we will: Where possible we will augment the offerings to meet our business needs (e.g.: CUWebAuth); Postpone less critical aspects of our intranet where improvements to CIT's service offerings look possible (work flow, portal); Where we can't wait, develop services that we hope can be migrated to campus or integrated into the campus offering (directory); And finally, develop "quick and dirty" solutions that we might be willing to throw away once CIT delivers the needed service (portal, document management).

The one service that does meet our business need as delivered, and we are committed to and anticipate using fully, is the Web Content Management System. Importantly, CIT involved a broad group of campus stakeholders in the selection and development of this service offering. Furthermore, because the governance of this offering involves very substantial involvement and these campus units, I feel comfortable that this service will continue to meet our business needs long into the future. Finally, I would be remiss if I didn't mention that since I was a part of the decision making body, I have more of a commitment to see that this works than I do for other areas addressed. Some people might argue that I've been co-opted by my invovlement, I would argue that, through my involvement, I became more aware of the trade offs and was more willing to accept and even promote and stand up for a decision that I might have been critical of, had I not been involved in it.

CIT's Web Content Management System selection and its ongoing governance plan provide a promising model for other CIT services. In addition, the grad school has developed a governance model as a part of their Graduate Application Processing System S-PAR that looks promising as well. A governance structure will not insure effective governance, the right charge, resources, and skills skills are also necessary. Finally governance depends on building effective informal relationships as well.

------------------------------------------------------------------------

Assessment of technologies and service offerings for college intranet

Engineering is currently undergoing a process of developing best practices for a number of our processes. Currently we are evaluating least 12 processes including everything from purchasing practices to appointing grad students. We've posted a now outdated list of these best practices topics.

In addition we have developed a dean's office intranet and based on that experience have decided we want to expand our intranet to the college. In addition to expanding the audience, we wish to expand the material covered and improve the usability of the site (both for web guests and content providers). Our goal is to eventually have one site where any staff or faculty will go as their first point of contact to find out about, initiate or complete any administrative process they are involved with. One stop shopping, as it were. We have a project web site and have posted the current draft site map. We hope to deliver the first section of our intranet this summer.

Clearly in developing a project such as this intranet we want to leverage the technologies available on campus. This is especially true since we have very limited resources and would like to be a good "University Citizen" and make whatever we develop available to a broader audience. Here is a list of the technologies we would like to incorporate in our intranet and the services that address them on campus:
  • Single sign-on authentication (CU Web Auth / Kerberos)
  • Web content management (CommonSpot)
  • Data delivery and reporting tools (Brio)
  • Portal infrastructure (uPortal)
  • Directory services (LDAP)
  • Web collaboration tools & project workspaces (not offered by CIT)
  • Work flow management (Web Methods, OneStart, & DFA's MetaStorm)
  • Document management (Fedora)
  • Course management (BlackBoard, Computer Science's course management system)
I have spent some time identifying and evaluating the technical offerings in these areas from CIT, though information about some of these offerings has been hard to gather. I know a good deal about the first six items listed and less about the next two and nothing about the course management systems.

Before I go on to evaluate the offerings and describe our current plans, I should note that Engineering has a significant track record of partnering with CIT. We were early and very active members of the CMS evaluation team and we have partnered with CIT and the grad school to migrate our graduate application processing system to CIT infrastructure. As a strategy we have tried to work with CIT and CIT provided infrastructure wherever it was prudent for us to do so.

Yet when I evaluate the seven CIT offerings I know much about, all but two of them do not look like they will currently meet our business needs. Of the seven areas described above, I anticipate we will use CIT's CMS offering fully and will augment CIT's Kerberos infrastructure to meet our business needs.

Below is my evaluation of each of CIT's offerings above.

Single sign on: CIT's Kerberos infrastructure is broadly used across campus and by and large addresses our needs. Since almost all of our target audience will all have netIDs, it is particularly well suited for and intranet. However it has several issues that we will have to work around.
  • Because CUWebAuth using sidecar re-authenticates the client each time it serves a document, it slows down web pages unacceptably. This is particularly a problem with byte served pdf documents where each time you hit the scroll bar you have two wait for a full re-authentication of the client. On our existing intranet we have addressed this by using CUWebLogin, but this is not an optimal solution. Currently my plan is to us CUWebAuth to authenticate users the first time they come to our intranet and then use CommonSpot's built in cookie based session management to authentication transactions from that point forward.
  • CIT's implementation of Kerberos means that each user can have only one login account. This is a problem for development and testing. Our intranet will display different information for different users and thus, we will need to create a "back door" authentication method to address this. This back door will also allow us to include people without netIDs, such as our vendor's programmers, to use our site. We will use CommonSpot's user management for these accounts.
  • I have asked and been promised to be included in assessments of functional needs for the future of single sign on for campus. Despite repeated promises to include me in a focus group over or other input mechanism over the last few years (the most recent promise was in May), none of these offers has materialized. I have little confidence that my input will be considered or our needs will be addressed. It is unlikely that CIT will deliver less functionality in the future, so I think there is little risk with our current plan.

Steve Edgar from Andrea's group in CIT has called me about these isseus and the directory. I will meet with him shortly to explore the guest authentication spec and see if that meets our needs. We'll also talk about the speed issue of CUWebAuth.

 

Web content management: CIT has recently coordinated the site license of Paper|Thin's CommonSpot web content management package. I was heavily involved in the evaluation and purchase of this system and the development of the long term governance strategy for the license. I would not have supported the purchase if I did not feel it would meet our needs. While it won't address all our needs, it was the best of the options that presented themselves. Furthermore, because of the governance structure, I have confidence that the tool will get wide acceptance and the collaboration among units using CommonSpot will address some of its short comings. Finally, because I and other units were involved in the process, we have a commitment to make this tool work. This makes it much more likely to get the critical mass needed to make it a broadly adopted service with good formal and informal support.

(At the first CommonSpot SIG meeting I addressed the history of CMS selection process and why I think this process was so successful.)

Data delivery and reporting tools: CIT's Brio infrastructure is very powerful and provides good access to institutional data. The new upgrade means that I can link to portal documents directly from our intranet. However many of the navigational shortcomings in our Brio infrastructure I described in a presentation in April 2003 still exist. I have addressed these limitations, in part, by posting custom engineering specific Brio documents to our existing intranet. This is a partial solution.

I would like also to be able to use the campus Brio infrastructure to deliver college specific data. I have met with Graham Hall and others on a number of occasions to try to develop a service that would allow this. For various reasons these efforts have been dropped. Most recently this service request was developed into an SPAR that grew to include a great deal of other items making it too expensive to be worth presenting to the ASP and SMG.

Portal infrastructure: In general, I am very bullish about web portals and was involved in the very successful specification and development of a portal at UC Davis 5 years ago. CIT provides a uPortal implementation that I have tried to use off and on for several years but have been less than satisfied with it. Independent of my efforts, I had our intranet project team evaluate uPortal. After trying to use it for a week they came back to me dissatisfied with it. We are having Jon Atherton present the new version of uPortal to our team next month and we will re-consider our evaluation based on that and an assessment of CALS uPortal effort.

Our main complaints with the existing uPortal implementation were:
  • It is very hard to use and to navigate.
  • You can't have a URL that leads directly to a portlet, so you can't share an important portlet with others.
  • The channels you need aren't in the default set up and the default channels aren't very useful.
  • Adding channels is arduous, even when you can figure out which channels to add from the very limited descriptions available.
  • The campus news available on the default portlets is often out of date.
  • The system is slow. So slow it exacerbates the already weak usability.
  • From an intranet design perspective, currently we can't provide a default group of portlets to our users based on their job title. This is a fundamental piece of functionality we intend to deliver to our users.
  • The governance of uPortal is in the hands of CIT technologists, and as such, is unlikely to ever meet our business needs as delivered. Our web vendor may be able to modify uPortal's delivery to meet our college's needs (as CALS is attempting to do), but it may be easier to develop our own portal implementation (either a uPortal implementation or from another vendor).

Directory services: CIT has put a great deal of work into it's LDAP implementation and it serves well as a phone directory. It currently has relatively weak membership authorization functions and CIT is planning on developing an entirely separate authorization directory. In both cases it appears that there is no functionality for authorized department staff to assign membership to other staff. The permit server provides some of this functionality but it is slated for retirement and does not have a good, general purpose user interface. It also does not allow our CMS to capture the full set of permits for a given person in one query. This later requirement is a necessity for our CUWebAuth work around (see above).

The end result is that we will build our own staff directory tool. Ideally we would want to develop a web interface for our tool, but a lot of authorization checking and validation needs to happen in the user interface so it may make sense to use a FileMaker interface. Clearly, once the campus LDAP system can incorporate our membership information, we will be in a position upload our membership data into LDAP. We may also be able to provide our tool as a general purpose front end for the campus LDAP authorization directory.

My immediate plan for starting discussions about the directory are to write up our business needs and perhaps the beginnings of a functional spec for our "people and memberships" tool and then discuss them with Steve Edgar (see above) and whomever esle would be appropriate and see how we can best work together.


Web collaboration, project workspace & knowledge management tools: CIT offers no technology offering in this space. Based on the success of the CMS purchase, if there is enough interest, I may propose a similar process to choose a campus solution for this domain as well. (At the first CommonSpot SIG meeting I addressed the history of the CMS purchase process and why I think this process was so successful.) Lacking broad interest, Engineering may select and purchase its own solution.

Work flow management: Currently there are three workflow solutions available or being considered on campus. DFA uses Meta Storm but they are phasing it out. CIT has a workflow tool associated with Web Methods but it hasn't been offered as a service and, if Kuali is adopted, it likely to be superceded by Kuali's OneStart work flow solution. In this case, financial transactions will be managed by OneStart so it is likely to become a campus standard.

Unfortunately, CIT plans on maintaining governance for this project internally. CIT's prior track record for projects governed internally is not good. See my notes about uPortal and LDAP above and the counter example of the CMS purchase. This gives me little hope that this work flow system implementation will be suitable for our business needs, especially on it's initial delivery.

As a result we will try to put off projects that require work flow and should CIT's option not be acceptable, we will augment OneStart, or develop or purchase our own.

When I left UC Davis 5 years ago they were using the University of Indiana's Work flow solution (in conjunction with the financial system they had acquired from Indiana). From what I saw, the work flow solution was well received but was, at the time limited in scope to financial transactions. OneStart has clearly moved beyond what UC Davis adopted.

Our graduate application processing system (GAPS) uses a custom work flow and document management solution which is unsuitable for more general use, though we will continue to use it for additional modules we add to GAPS such as faculty search processing.

Document management: We will want some document management functionality associated with the workflow tools on our intranet. Currently GAPS stores scanned documents on the file system and stores the metadata in a database. This doesn't allow full document life cycle management but will probably be acceptable for our initial needs. From what I've read, Fedora it targeted at a very different set of business needs and may be more suitable, but I don't know enough about it. We're only beginning to understand what our business needs are likely to be in this area, but clearly we would like document versioning, rich indexing and searching, ability to tie a document to the work flow that produced it, metadata and knowledge management functionality, and finally archive and destruction management.

Possibly course management: CIT offers Blackboard as a service but I haven't evaluated it. I know that Computer Science offers a similar home grown service as well. I have done no business needs assessment in this area.

----------------------------------------------------------------------

Governance models

CIT's CMS selection process was very promising. The history of the selection process and outlines of the governance model are described in the CMS SIG kick off meeting presentation. In planning this governance model I wrote a document about Improving Stakeholder Involvement in IT projects .

My thinking has changed a bit since I wrote this. I wrote it from end users perspective up. More recently I've been thinking about it from the executive sponsor's perspective down through a steering committee, that is influenced by an advisory board and a SIG, and has oversight of the project manager. I think the best description of this sort of approach I've seen recently was Sarah Hale's description of the governance model for the GAPS project once it is taken over by the grad school. See below:

How will we make sure that the on-line application working group includes PeopleSoft representation?

We recognize that PeopleSoft integration issues need to be taken into account in development of the on-line admissions application.  We will develop a leadership structure for GAPS that will involve stakeholders from Engineering, CIT, the graduate faculty, the graduate field assistants, and the Graduate School.

The governance model relies on:  1) a steering committee of six individuals--two each from the College of Engineering, CIT, and the Graduate School--to guide the GAPS implementation; and 2) an advisory committee of 10-12 individuals to report to, and advise, the steering committee.  CIT would be represented on both the steering committee and the advisory committee.  We will ask CIT to appoint individuals who have technical knowledge of PeopleSoft and who can assist in representing the functional aspects of the PeopleSoft implementation as appropriate.  Functional PeopleSoft issues would be represented on the steering committee by Sarah Hale, who is a member of the University Admissions Advisory Group convened by Doris Davis as part of the PeopleSoft implementation. We would also ask the Graduate School's functional lead for the PeopleSoft Admissions effort (Doug Elliot) to serve on the advisory committee in an ex officio capacity (meetings only) as a link between the projects; that individual would serve in an advisory role only and would not be asked to take on any tasks for the committee.

Steering Committee:  As noted above, CIT will appoint two individuals (at least one of whom has technical PeopleSoft knowledge) to the steering committee.  Engineering will appoint Paul Davis and Craig Higgins to the steering committee.  The Graduate School will appoint Sarah Hale and John Tonello to the committee.  Craig Higgins and Sarah Hale will co-chair the committee. 

Advisory Committee: The 10-12 person advisory committee would be comprised of the two steering committee co-chairs, graduate faculty representatives, graduate field assistants representatives, and other staff as appropriate.  The Graduate School PeopleSoft functional lead would serve in an ex officio capacity (meeting attendance but no assigned tasks).  The charge of the advisory committee would be to:  1) assist in defining functional requirements for the on-line admissions application and the on-line application review system (GAPS); 2) prioritize requests for system enhancements; 3) develop communications and training plans; and 4) provide constructive comments and criticisms.  Advisory Committee members would be expected to attend one meeting per month and to provide ongoing advocacy for the initiative as well as to assist with testing and training as appropriate.

Open Membership Working Group:  We also envision an open membership group--tentatively named the Cornell Application Review and Tracking (CART) working group--chaired by members of the advisory committee.  This group would be comprised of faculty and staff who share an interest in graduate admissions.  The advisory committee would report to this open membership group to ensure that graduate faculty and field assistants have a voice in the GAPS implementation.


I will note that even the right organizational structure can still fail due to "implementation details". Here are some examples:

  • The wrong stakeholder concerns are identified when choosing members for the steering and advisory committees. For instance the steering committee could founder because it includes powerful members who don't care about the project or service. Alternatively the results could be seen as illegitimate because powerful people who do care are not consulted.
  • The individuals placed in the steering and advisory committees are not given the right charge. For instance, if the steering committee members are supposed to represent the campus needs, and they represent their own interests, the results could be seen as illegitimate. (Thanks to Mark for this example and for making me thing about this. Based on his suggestion, I would propose that each steering committee member be given an individual charge. In most cases it will include representing the needs of a specific body of stakeholders.)
  • The steering committee is not created early enough in the decision making process or is not given the time they need to get the stakeholder input they need to make a decisions that are viewed by the broader stakeholders as legitimate.
  • The steering committee does not have the leadership, skills or resources it needs.

 

Informal Relationships

Organizational culture, forums for open communication at many levels of the organization (especially between middle managers), and the informal relationships within and especially between units are also important considerations for effective discovery and governance. It will help us get beyond thinking of CIT or the functional and academic units as "the other". We need to see that we are all in this together. There are several ways we can encourage this:

  • Create training opportunities that would be of interest to and open to all IT staff across the university.
  • When either the functional and academic units or CIT has a retreat, if the topic is appropriate, invite members from other units to the retreat.
  • Continue and expand the very effective CIT Division Forums. Perhaps add an explicit networking time after the meetings, perhaps with snacks and so forth.
  • Functional and Academic unit staff and CIT staff should make an effort to, and be rewarded for, calling each other up for advice, etc. (This of course requires that these staff have slack in their schedule to allow this sort of informality.)
  • Obviously the IT administrative systems funding model works against informal relationships on many levels. Fixing this would be a great help in many areas.

 

Getting Stakeholder input

One of the big problems with gathering sakeholder input is getting the stakeholders interested enough to become engaged early in the process when their input can be really useful. Once they can start seeing what is happening, normally late in the implementation phase, they will get themselves invovled, normally to the detriment of the project. There are many examples of decision processes where stakeholder input was taken, but important and powerful stakeholders didn't get involved until too late and they stopped the process during the implementation phase or later. The earlier stakeholder process wasn't seen as legitimate.

 

This leads to the question, what are the best ways to gather stakeholder input? How do you get them interested in the issues early enough to be useful to the process? And the related question, how do you educate them enough so they are interested and their input is useful?

 

There is a whole discipline associated with gathering stakeholder input and requirements. Actually they are sub-disciplines of many different areas. The area I know most about, because of my wife's research, is public participation for technical decisions, siting hazardous waste facilities in her case. Fortunately, for Cornell, we all have a common organization and mission so many of the really difficult issues she studied are much easier here.

 

I think the most important things I've learned from the public participation literature is:

  • Getting disparate stakeholders to work together is possible, it takes time and resources, but done right the results are seen as legitimate and there is real buy in. The buy in creates opportunities for synergy and for real respect accross organizational boundaries.
  • The stakeholder process, by it's nature educates all the participants. They are likely to be a supporter for a outcome they might have been opposed to without that education.
  • Stakeholder processes, done right, can turn the biggest enemies of the project into the biggest supporters of the outcome (sometimes).
  • Done wrong (stakeholders input doesn't have the expected impact on the outcome), a stakeholder process will educate the stakeholders who are opposed to the project and they will become more formidible enemies.
  • It generally doesn't serve your purposes to do a stakeholder process half way, either you are interested in their input and it will use it, or you may not want to do the stakeholder process.
  • A stakeholder process is very different than a series of focus groups or user input sessions. The focus group participants and users are unlikely to have, or through the input session, to gain a great deal of knowledge of the situation. They are unlikely to become invested in the outcome. As a result of their lack of interest and knowledge, generally they don't provide much useful input. In a stakeholder process, the participants have a real stake in the process, they become educated through the process, and it is clear to them that they will have an impact on the outcome. They can see the value of their effort.
  • Stakeholder processes work better when failure would clearly be worse for all the stakeholders invovled. All the stakeholders have to know that their is a hammer over their head (and what the hammer is) if this doesn't work. Sometimes you have to work hard to educate the "under interested" stakeholders about the "hammer" to get them interested.
  • Sometimes you can be creative in creating that hammer. The Tanner Act uses government policy to define failure and create a situation of great uncertainty for both sides if failure of the process occurs.

 

Now to switch gears to a more directly relevent material, my brother does IT consulting associated with developing new systems for banks, etc. The way he describes his standard practice is they do a day long retreat with the president of the bank and the prime stakeholders. For the first half of the day they teach the stakeholders about the technological options available (it used to be screen scraper type integration, more recently he's been data integration with a web front end). For the second half of the day, they start by using the mission of the organization to help decide what projects to focus on. The education from the first part of the day informs the discussion about what projects are possible. Obviously, before the retreat, my brother and his team do a lot of preparation and have a list of problems (and possible projects) they can address. This also helps them focus the presentation of the technical options.

 

I've discussed some of the tools I use to help develop shared understanding in meetings on my list of project management tools.

 

IT as an Organizational Change Maker

My feeling is that because the technology that IT introduces is often a disruptive force in business processes, the technology has to be married to the business purpose and business stakeholders. As an example, our intranet project will be documenting business processes college wide. We could simply document the processes that are in place in each department and let people from each department use their department's version of the process. Or we could encourage and work with the business stakeholders college wide to have them develop common processes. This tehcnology project provides a great opportunity and impitus to identify needlessly disparate processes and help make them more consistant.

 

The Administrative Systems Funding Model

It is clear that the Administrative Systems funding model drives the IT governance and decision making behaviors we see on campus, both within CIT and across campus. It also explains why CIT's Admin systems group has historically seen its customers as the ASP, rather than the campus at large. It is not clear that this can or will change in the short term however. That said, I think there is much we can do and a great deal of interest in improving IT governance and behaviors accross campus.

 

 

______________________________________________
Paul Davis
Programmer/Analyst Sr.
Engineering Dean's Office, Cornell University
245 Carpenter Hall
Ithaca, NY 14853
(607) 255-6227 (office)   (607) 255-9606 (fax)
mailto:prd9@cornell.edu
http://intranet.engr.cornell.edu/intranet/it
http://intranet.engr.cornell.edu/home/prd9

 
 
Maintained by Paul Davis   |   Last updated 2007-09-18
Cornell University Cornell University Cornell University College of Engineering