| |
|
|
Assessment of CIT Services for College Intranet
I wrote the following email to Mark Mara of CIT in order to frame
a discussion and to present my perspective. I wrote almost all of
it in a four hour sitting before work so it may contains factual
errors. (Correcting these misunderstandings on my part, was, after
all, part of the reason I wanted to talk with Mark.) As I learn
more, I will try to correct and update this document as I can, at
least through our intranet
discovery phase.
-Paul
Date: Tue, 25 Jan 2005 07:45:16 -0500
To: Mark A Mara <mam1@cornell.edu>
From: Paul Davis <prd9@cornell.edu>
Subject: Assessment of CIT services for college intranet
Cc: cel3@cornell.edu (Cathy Long)
Bcc: paul.davis@gmail.com
Mark, In preparation of our meeting tomorrow I've written up my current
assessment of CIT's services as they apply to our intranet project.
I'd like to use it as a discussion starter for tomorrow. Since I hear
you are particularly involved in the workflow management part of this
puzzle, I'd like to start the discussion there. I am also very interested
in discussing IT governance in relation to this effort.
-Paul
Below are three sections. First an executive summary, then a more
in-depth evaluation of CIT's technology offerings that are applicable
to our intranet project and finally some promising IT governance models
I've seen in relation to two CIT projects.
Executive Summary
Engineering is planning to develop a college wide intranet with
roll out of the first phase anticipated this summer. In this process
we have identified the following 9 technologies we would eventually
like to use, CIT offers, or is considering offering, services for
8 of them:
- Single sign-on authentication (CU Web Auth / Kerberos)
- Web content management (CommonSpot)
- Data delivery and reporting tools (Brio)
- Portal infrastructure (uPortal)
- Directory services (LDAP directory, Authorization directory)
- Web collaboration tools & project workspaces (not currently
offered by CIT)
- Work flow management (Web Methods, OneStart, & DFA's MetaStorm)
- Document management (Fedora, Hein On-Line)
- Course management (BlackBoard, Sekia)
In our evaluation of CIT's offerings, we have found only two that
meet our business needs well enough that we will include them in our
first phase. They are CommonSpot and CUWebAuth.
In response to this situation we will: Where possible we will augment
the offerings to meet our business needs (e.g.: CUWebAuth); Postpone
less critical aspects of our intranet where improvements to CIT's
service offerings look possible (work flow, portal); Where we can't
wait, develop services that we hope can be migrated to campus or integrated
into the campus offering (directory); And finally, develop "quick
and dirty" solutions that we might be willing to throw away once
CIT delivers the needed service (portal, document management).
The one service that does meet our business need as delivered, and
we are committed to and anticipate using fully, is the Web Content
Management System. Importantly, CIT involved a broad group of campus
stakeholders in the selection and development of this service offering.
Furthermore, because the governance of this offering involves very
substantial involvement and these campus units, I feel comfortable
that this service will continue to meet our business needs long into
the future. Finally, I would be remiss if I didn't mention that since
I was a part of the decision making body, I have more of a commitment
to see that this works than I do for other areas addressed. Some people
might argue that I've been co-opted by my invovlement, I would argue
that, through my involvement, I became more aware of the trade offs
and was more willing to accept and even promote and stand up for a
decision that I might have been critical of, had I not been involved
in it.
CIT's Web Content Management System selection and its ongoing governance
plan provide a promising model for other CIT services. In addition,
the grad school has developed a governance model as a part of their
Graduate Application Processing System S-PAR that looks promising
as well. A governance structure will not insure effective governance,
the right charge, resources, and skills skills are also necessary.
Finally governance depends on building effective informal relationships
as well.
------------------------------------------------------------------------
Assessment of technologies and service offerings
for college intranet
Engineering is currently undergoing a process of developing best
practices for a number of our processes. Currently we are evaluating
least 12 processes including everything from purchasing practices
to appointing grad students. We've posted a now
outdated list of these best practices topics.
In addition we have developed a dean's
office intranet
and based on that experience have decided we want to expand our intranet
to the college. In addition to expanding the audience, we wish to
expand the material covered and improve the usability of the site
(both for web guests and content providers). Our goal is to eventually
have one site where any staff or faculty will go as their first point
of contact to find out about, initiate or complete any administrative
process they are involved with. One stop shopping, as it were. We
have a project
web site and have posted the
current draft site map. We hope to deliver the first section of
our intranet this summer.
Clearly in developing a project such as this intranet we want to leverage
the technologies available on campus. This is especially true since
we have very limited resources and would like to be a good "University
Citizen" and make whatever we develop available to a broader
audience. Here is a list of the technologies we would like to incorporate
in our intranet and the services that address them on campus:
- Single sign-on authentication (CU Web Auth / Kerberos)
- Web content management (CommonSpot)
- Data delivery and reporting tools (Brio)
- Portal infrastructure (uPortal)
- Directory services (LDAP)
- Web collaboration tools & project workspaces (not offered
by CIT)
- Work flow management (Web Methods, OneStart, & DFA's MetaStorm)
- Document management (Fedora)
- Course management (BlackBoard, Computer Science's course management
system)
I have spent some time identifying and evaluating the technical offerings
in these areas from CIT, though information about some of these offerings
has been hard to gather. I know a good deal about the first six items
listed and less about the next two and nothing about the course management
systems.
Before I go on to evaluate the offerings and describe our current
plans, I should note that Engineering has a significant track record
of partnering with CIT. We were early and very active members of the
CMS evaluation team and we have partnered with CIT and the grad school
to migrate our graduate application processing system to CIT infrastructure.
As a strategy we have tried to work with CIT and CIT provided infrastructure
wherever it was prudent for us to do so.
Yet when I evaluate the seven CIT offerings I know much about, all
but two of them do not look like they will currently meet our business
needs. Of the seven areas described above, I anticipate we will use
CIT's CMS offering fully and will augment CIT's Kerberos infrastructure
to meet our business needs.
Below is my evaluation of each of CIT's offerings above.
Single sign on: CIT's Kerberos infrastructure
is broadly used across campus and by and large addresses our needs.
Since almost all of our target audience will all have netIDs, it is
particularly well suited for and intranet. However it has several
issues that we will have to work around.
- Because CUWebAuth using sidecar re-authenticates the client
each time it serves a document, it slows down web pages unacceptably.
This is particularly a problem with byte served pdf documents
where each time you hit the scroll bar you have two wait for a
full re-authentication of the client. On our existing intranet
we have addressed this by using CUWebLogin, but this is not an
optimal solution. Currently my plan is to us CUWebAuth to authenticate
users the first time they come to our intranet and then use CommonSpot's
built in cookie based session management to authentication transactions
from that point forward.
- CIT's implementation of Kerberos means that each user can have
only one login account. This is a problem for development and
testing. Our intranet will display different information for different
users and thus, we will need to create a "back door"
authentication method to address this. This back door will also
allow us to include people without netIDs, such as our vendor's
programmers, to use our site. We will use CommonSpot's user management
for these accounts.
- I have asked and been promised to be included in assessments
of functional needs for the future of single sign on for campus.
Despite repeated promises to include me in a focus group over
or other input mechanism over the last few years (the most recent
promise was in May), none of these offers has materialized. I
have little confidence that my input will be considered or our
needs will be addressed. It is unlikely that CIT will deliver
less functionality in the future, so I think there is little risk
with our current plan.
Steve Edgar from Andrea's group in CIT has called me about these
isseus and the directory. I will meet with him shortly to explore
the guest authentication spec and see if that meets our needs. We'll
also talk about the speed issue of CUWebAuth.
Web content management: CIT has recently
coordinated the site license of Paper|Thin's CommonSpot web content
management package. I was heavily involved in the evaluation and purchase
of this system and the development of the long term governance strategy
for the license. I would not have supported the purchase if I did
not feel it would meet our needs. While it won't address all our needs,
it was the best of the options that presented themselves. Furthermore,
because of the governance structure, I have confidence that the tool
will get wide acceptance and the collaboration among units using CommonSpot
will address some of its short comings. Finally, because I and other
units were involved in the process, we have a commitment to make this
tool work. This makes it much more likely to get the critical mass
needed to make it a broadly adopted service with good formal and informal
support.
(At the first CommonSpot SIG meeting I addressed the history of CMS
selection process and why I think this
process was so successful.)
Data delivery and reporting tools: CIT's
Brio infrastructure is very powerful and provides good access to institutional
data. The new upgrade means that I can link to portal documents directly
from our intranet. However many of the navigational shortcomings in
our Brio infrastructure I described in a presentation
in April 2003 still exist. I have addressed these limitations, in
part, by posting custom engineering specific Brio documents to our
existing intranet. This is a partial solution.
I would like also to be able to use the campus Brio infrastructure
to deliver college specific data. I have met with Graham Hall and
others on a number of occasions to try to develop a service that would
allow this. For various reasons these efforts have been dropped. Most
recently this service request was developed into an SPAR
that grew to include a great deal of other items making it too expensive
to be worth presenting to the ASP and SMG.
Portal infrastructure: In general, I am
very bullish about web portals and was involved in the very successful
specification and development of a portal at UC Davis 5 years ago.
CIT provides a uPortal implementation that I have tried to use off
and on for several years but have been less than satisfied with it.
Independent of my efforts, I had our intranet project team evaluate
uPortal. After trying to use it for a week they came back to me dissatisfied
with it. We are having Jon Atherton present the new version of uPortal
to our team next month and we will re-consider our evaluation based
on that and an assessment of CALS uPortal effort.
Our main complaints with the existing uPortal implementation were:
- It is very hard to use and to navigate.
- You can't have a URL that leads directly to a portlet, so you
can't share an important portlet with others.
- The channels you need aren't in the default set up and the default
channels aren't very useful.
- Adding channels is arduous, even when you can figure out which
channels to add from the very limited descriptions available.
- The campus news available on the default portlets is often out
of date.
- The system is slow. So slow it exacerbates the already weak
usability.
- From an intranet design perspective, currently we can't provide
a default group of portlets to our users based on their job title.
This is a fundamental piece of functionality we intend to deliver
to our users.
- The governance of uPortal is in the hands of CIT technologists,
and as such, is unlikely to ever meet our business needs as delivered.
Our web vendor may be able to modify uPortal's delivery to meet
our college's needs (as CALS is attempting to do), but it may
be easier to develop our own portal implementation (either a uPortal
implementation or from another vendor).
Directory services: CIT has put
a great deal of work into it's LDAP implementation and it serves
well as a phone directory. It currently has relatively weak membership
authorization functions and CIT is planning on developing an entirely
separate authorization directory. In both cases it appears that
there is no functionality for authorized department staff to assign
membership to other staff. The permit server provides some of this
functionality but it is slated for retirement and does not have
a good, general purpose user interface. It also does not allow our
CMS to capture the full set of permits for a given person in one
query. This later requirement is a necessity for our CUWebAuth work
around (see above).
The end result is that we will build our own staff directory tool.
Ideally we would want to develop a web interface for our tool, but
a lot of authorization checking and validation needs to happen in
the user interface so it may make sense to use a FileMaker interface.
Clearly, once the campus LDAP system can incorporate our membership
information, we will be in a position upload our membership data
into LDAP. We may also be able to provide our tool as a general
purpose front end for the campus LDAP authorization directory.
My immediate plan for starting discussions about the directory
are to write up our business needs and perhaps the beginnings of
a functional spec for our "people and memberships" tool
and then discuss them with Steve Edgar (see above) and whomever
esle would be appropriate and see how we can best work together.
Web collaboration, project workspace
& knowledge management tools: CIT offers no technology offering
in this space. Based on the success of the CMS purchase, if there
is enough interest, I may propose a similar process to choose a
campus solution for this domain as well. (At the first CommonSpot
SIG meeting I addressed the history of the CMS purchase process
and why I think this
process was so successful.) Lacking broad interest, Engineering
may select and purchase its own solution.
Work flow management: Currently there
are three workflow solutions available or being considered on campus.
DFA uses Meta Storm but they are phasing it out. CIT has a workflow
tool associated with Web Methods but it hasn't been offered as a
service and, if Kuali is adopted, it likely to be superceded by
Kuali's OneStart work flow solution. In this case, financial transactions
will be managed by OneStart so it is likely to become a campus standard.
Unfortunately, CIT plans on maintaining governance for this project
internally. CIT's prior track record for projects governed internally
is not good. See my notes about uPortal and LDAP above and the counter
example of the CMS purchase. This gives me little hope that this
work flow system implementation will be suitable for our business
needs, especially on it's initial delivery.
As a result we will try to put off projects that require work flow
and should CIT's option not be acceptable, we will augment OneStart,
or develop or purchase our own.
When I left UC Davis 5 years ago they were using the University
of Indiana's Work flow solution (in conjunction with the financial
system they had acquired from Indiana). From what I saw, the work
flow solution was well received but was, at the time limited in
scope to financial transactions. OneStart has clearly moved beyond
what UC Davis adopted.
Our graduate application processing system (GAPS) uses a custom
work flow and document management solution which is unsuitable for
more general use, though we will continue to use it for additional
modules we add to GAPS such as faculty search processing.
Document management: We will want some
document management functionality associated with the workflow tools
on our intranet. Currently GAPS stores scanned documents on the
file system and stores the metadata in a database. This doesn't
allow full document life cycle management but will probably be acceptable
for our initial needs. From what I've read, Fedora it targeted at
a very different set of business needs and may be more suitable,
but I don't know enough about it. We're only beginning to understand
what our business needs are likely to be in this area, but clearly
we would like document versioning, rich indexing and searching,
ability to tie a document to the work flow that produced it, metadata
and knowledge management functionality, and finally archive and
destruction management.
Possibly course management: CIT
offers Blackboard as a service but I haven't evaluated it. I know
that Computer Science offers a similar home grown service as well.
I have done no business needs assessment in this area.
----------------------------------------------------------------------
Governance models
CIT's CMS selection process was very promising. The history
of the selection process and outlines of the governance model are
described in the CMS
SIG kick off meeting presentation. In planning this governance
model I wrote a document about Improving
Stakeholder Involvement in IT projects .
My thinking has changed a bit since I wrote this. I wrote it from
end users perspective up. More recently I've been thinking about
it from the executive sponsor's perspective down through a steering
committee, that is influenced by an advisory board and a SIG, and
has oversight of the project manager. I think the best description
of this sort of approach I've seen recently was Sarah Hale's description
of the governance model for the GAPS project once it is taken over
by the grad school. See below:
How will we make sure that
the on-line application working group includes PeopleSoft representation?
We recognize that PeopleSoft integration issues need to be taken
into account in development of the on-line admissions application.
We will develop a leadership structure for GAPS that will involve
stakeholders from Engineering, CIT, the graduate faculty, the graduate
field assistants, and the Graduate School.
The governance model relies on: 1) a steering committee of
six individuals--two each from the College of Engineering, CIT,
and the Graduate School--to guide the GAPS implementation; and 2)
an advisory committee of 10-12 individuals to report to, and advise,
the steering committee. CIT would be represented on both the
steering committee and the advisory committee. We will ask
CIT to appoint individuals who have technical knowledge of PeopleSoft
and who can assist in representing the functional aspects of the
PeopleSoft implementation as appropriate. Functional PeopleSoft
issues would be represented on the steering committee by Sarah Hale,
who is a member of the University Admissions Advisory Group convened
by Doris Davis as part of the PeopleSoft implementation. We would
also ask the Graduate School's functional lead for the PeopleSoft
Admissions effort (Doug Elliot) to serve on the advisory committee
in an ex officio capacity (meetings only) as a link between the
projects; that individual would serve in an advisory role only and
would not be asked to take on any tasks for the committee.
Steering Committee: As noted above, CIT will
appoint two individuals (at least one of whom has technical PeopleSoft
knowledge) to the steering committee. Engineering will appoint
Paul Davis and Craig Higgins to the steering committee. The
Graduate School will appoint Sarah Hale and John Tonello to the
committee. Craig Higgins and Sarah Hale will co-chair the
committee.
Advisory Committee: The 10-12 person advisory committee
would be comprised of the two steering committee co-chairs, graduate
faculty representatives, graduate field assistants representatives,
and other staff as appropriate. The Graduate School PeopleSoft
functional lead would serve in an ex officio capacity (meeting attendance
but no assigned tasks). The charge of the advisory committee
would be to: 1) assist in defining functional requirements
for the on-line admissions application and the on-line application
review system (GAPS); 2) prioritize requests for system enhancements;
3) develop communications and training plans; and 4) provide constructive
comments and criticisms. Advisory Committee members would
be expected to attend one meeting per month and to provide ongoing
advocacy for the initiative as well as to assist with testing and
training as appropriate.
Open Membership Working Group: We also envision
an open membership group--tentatively named the Cornell Application
Review and Tracking (CART) working group--chaired by members of
the advisory committee. This group would be comprised of faculty
and staff who share an interest in graduate admissions. The
advisory committee would report to this open membership group to
ensure that graduate faculty and field assistants have a voice in
the GAPS implementation.
I will note that even the right
organizational structure can still fail due to "implementation
details". Here are some examples:
- The wrong stakeholder concerns are identified when choosing
members for the steering and advisory committees. For instance
the steering committee could founder because it includes powerful
members who don't care about the project or service. Alternatively
the results could be seen as illegitimate because powerful people
who do care are not consulted.
- The individuals placed in the steering and advisory committees
are not given the right charge. For instance, if the steering
committee members are supposed to represent the campus needs,
and they represent their own interests, the results could be seen
as illegitimate. (Thanks to Mark for this example and for making
me thing about this. Based on his suggestion, I would propose
that each steering committee member be given an individual charge.
In most cases it will include representing the needs of a specific
body of stakeholders.)
- The steering committee is not created early enough in the decision
making process or is not given the time they need to get the stakeholder
input they need to make a decisions that are viewed by the broader
stakeholders as legitimate.
- The steering committee does not have the leadership, skills
or resources it needs.
Informal Relationships
Organizational culture, forums for open communication at many levels
of the organization (especially between middle managers), and the
informal relationships within and especially between units are also
important considerations for effective discovery and governance.
It will help us get beyond thinking of CIT or the functional and
academic units as "the other". We need to see
that we are all in this together. There are several ways we can
encourage this:
- Create training opportunities that would be of interest to and
open to all IT staff across the university.
- When either the functional and academic units or CIT has a retreat,
if the topic is appropriate, invite members from other units to
the retreat.
- Continue and expand the very effective CIT Division Forums.
Perhaps add an explicit networking time after the meetings, perhaps
with snacks and so forth.
- Functional and Academic unit staff and CIT staff should make
an effort to, and be rewarded for, calling each other up for advice,
etc. (This of course requires that these staff have slack
in their schedule to allow this sort of informality.)
- Obviously the IT administrative systems funding model works
against informal relationships on many levels. Fixing this would
be a great help in many areas.
Getting Stakeholder input
One of the big problems with gathering sakeholder input is getting
the stakeholders interested enough to become engaged early in the
process when their input can be really useful. Once they can start
seeing what is happening, normally late in the implementation phase,
they will get themselves invovled, normally to the detriment of
the project. There are many examples of decision processes where
stakeholder input was taken, but important and powerful stakeholders
didn't get involved until too late and they stopped the process
during the implementation phase or later. The earlier stakeholder
process wasn't seen as legitimate.
This leads to the question, what are the best ways to gather stakeholder
input? How do you get them interested in the issues early enough
to be useful to the process? And the related question, how do you
educate them enough so they are interested and their input is useful?
There is a whole discipline associated with gathering stakeholder
input and requirements. Actually they are sub-disciplines of many
different areas. The area I know most about, because of my wife's
research, is public participation for technical decisions, siting
hazardous waste facilities in her case. Fortunately, for Cornell,
we all have a common organization and mission so many of the really
difficult issues she studied are much easier here.
I think the most important things I've learned from the public
participation literature is:
- Getting disparate stakeholders to work together is possible,
it takes time and resources, but done right the results are seen
as legitimate and there is real buy in. The buy in creates opportunities
for synergy and for real respect accross organizational boundaries.
- The stakeholder process, by it's nature educates all the participants.
They are likely to be a supporter for a outcome they might have
been opposed to without that education.
- Stakeholder processes, done right, can turn the biggest enemies
of the project into the biggest supporters of the outcome (sometimes).
- Done wrong (stakeholders input doesn't have the expected impact
on the outcome), a stakeholder process will educate the stakeholders
who are opposed to the project and they will become more formidible
enemies.
- It generally doesn't serve your purposes to do a stakeholder
process half way, either you are interested in their input and
it will use it, or you may not want to do the stakeholder process.
- A stakeholder process is very different than a series of focus
groups or user input sessions. The focus group participants and
users are unlikely to have, or through the input session, to gain
a great deal of knowledge of the situation. They are unlikely
to become invested in the outcome. As a result of their lack of
interest and knowledge, generally they don't provide much useful
input. In a stakeholder process, the participants have a real
stake in the process, they become educated through the process,
and it is clear to them that they will have an impact on the outcome.
They can see the value of their effort.
- Stakeholder processes work better when failure would clearly
be worse for all the stakeholders invovled. All the stakeholders
have to know that their is a hammer over their head (and what
the hammer is) if this doesn't work. Sometimes you have to work
hard to educate the "under interested" stakeholders
about the "hammer" to get them interested.
- Sometimes you can be creative in creating that hammer. The Tanner
Act uses government policy to define failure and create a situation
of great uncertainty for both sides if failure of the process
occurs.
Now to switch gears to a more directly relevent material, my brother
does IT consulting associated with developing new systems for banks,
etc. The way he describes his standard practice is they do a day
long retreat with the president of the bank and the prime stakeholders.
For the first half of the day they teach the stakeholders about
the technological options available (it used to be screen scraper
type integration, more recently he's been data integration with
a web front end). For the second half of the day, they start by
using the mission of the organization to help decide what projects
to focus on. The education from the first part of the day informs
the discussion about what projects are possible. Obviously, before
the retreat, my brother and his team do a lot of preparation and
have a list of problems (and possible projects) they can address.
This also helps them focus the presentation of the technical options.
I've discussed some of the tools
I use to help develop shared understanding in meetings on my
list of project management tools.
IT as an Organizational Change
Maker
My feeling is that because the technology that IT introduces is
often a disruptive force in business processes, the technology has
to be married to the business purpose and business stakeholders.
As an example, our intranet project will be documenting business
processes college wide. We could simply document the processes that
are in place in each department and let people from each department
use their department's version of the process. Or we could encourage
and work with the business stakeholders college wide to have them
develop common processes. This tehcnology project provides a great
opportunity and impitus to identify needlessly disparate processes
and help make them more consistant.
The Administrative Systems Funding
Model
It is clear that the Administrative Systems funding model drives
the IT governance and decision making behaviors we see on campus,
both within CIT and across campus. It also explains why CIT's Admin
systems group has historically seen its customers as the ASP, rather
than the campus at large. It is not clear that this can or will
change in the short term however. That said, I think there is much
we can do and a great deal of interest in improving IT governance
and behaviors accross campus.
______________________________________________
Paul Davis
Programmer/Analyst Sr.
Engineering Dean's Office, Cornell University
245 Carpenter Hall
Ithaca, NY 14853
(607) 255-6227 (office) (607) 255-9606 (fax)
mailto:prd9@cornell.edu
http://intranet.engr.cornell.edu/intranet/it
http://intranet.engr.cornell.edu/home/prd9
|
|