Monday

Tag Archives: Communication

Defining Project Success using Project Success Criteria

Posted on July 4, 2017 by | 4 comments

Everyone likes a successful project but the big question is what makes a project successful??  A good example is the Sydney Opera House; was the Sydney Opera House successful or not?

The project ran significantly over budget finished very late and was technically less than perfect; $millions are currently being spent rectifying many of the technical deficiencies in the building. But can anyone say Sydney Opera House is not one of the most recognised and therefore successful buildings in the world?[1]

Success is an ephemeral concept! Different people will have different perspectives and judge the success or failure project differently. Neither a project nor a program manager can control many of the factors that have made the Sydney Opera House worldwide icon but they can address the concept of success with their stakeholders and then work to deliver a successful outcome based on these discussions.

So what is success? There are probably three key elements, but these frequently create a paradox that requires a balanced approach to success. The three fundamental elements are:

  • The Iron Triangle (Scope + Cost + Time)
  • Benefits realised (or maximised)
  • Satisfied stakeholders (but, when??)

One of the key paradox is a myopic focus on the Iron Triangle particularly time and cost can frequently destroy benefits and leave the stakeholders unhappy, but focusing on keeping stakeholders happy can frequently have detrimental effects on the Iron Triangle. There are no easy solutions to this problem[2].

In my view, the successful delivery of a project or program requires:

  • Achieving the overall goal for the project;
  • Delivering its objectives; and
  • Meeting its success criteria.

But, to achieve success you need to define and agree the project goal, the project objectives, and the project success criteria with your key stakeholders with a view to achieving a combination of stakeholder satisfaction and value created. The goal and objectives frame the project’s work and direction. The success criteria frame how the objectives are achieved.

 

The Project Goal

Goals are high-level statements that provide the overall context defining what the project is trying to achieve. One project should have one goal (if there are multiple goals you are most likely looking at a program of work[3])!  For example:  Within 180 days, reduce the pollution in the rainwater runoff from a council tip by 98%.

The goal is a key statement in the Project Charter[4] and if the project is to be successful, all key stakeholders need to agree the goal.  The goal needs to be specific and should define the project in a way that focuses attention on the key outcomes required for overall success from a technical and strategic business perspective[5].

 

Project Objectives

The objectives are lower level statements that describe the specific, tangible products and deliverables that the project will create; each objective (and the overall goal) should be SMART[6]. For the runoff project the objectives may include:

  • Develop wetlands to trap 99.8% of sediment
  • Install channels to collect and direct the runoff
  • Install screens remove floating debris
  • Etc….. There will be a number of objectives……

Each objective requires defining and specifying with clear performance criteria so you know when it has been achieved. This may be done by the client or by the project team during the scope definition process. The performance criteria may be defined by a set of precise specifications that are specific and measurable or may be defined as a performance requirement with either:

  • The external contractor to provide the specific details of how the objective will be achieved, or
  • The internal project team to develop the details in consultation with the client

The defined objectives are the building blocks that facilitate the achievement of the goal and the creation of the benefits the organisation is expecting from the project[7]. The benefits need to be realised to create value.

 

Success criteria

Success criteria are different they measure what’s important to your stakeholders. Consequently, they are the standards by which the project will be judged at the end to decide whether or not it has been successful in the eyes of its stakeholders. As far as possible the stakeholders need to be satisfied; this includes having their expectations fulfilled and in general terms being pleased with both the journey and the outcome (in this respect scope, cost and/or time may be important).

Success criteria can be expressed in many different ways some examples include:

  • Zero accidents / no environmental issues;
  • No ‘bad press’ / good publicity received;
  • Finalist in the project achievement awards;
  • Plus the goal and all of the objectives achieved (yes – you still need to do the work).

For any project, the success criteria should be split between project management success criteria which of related to the professional aspects of running the project; plus project deliverable success criteria which are related to the performance and function of the deliverable.

Documenting the success criteria is important, it means you can get project stakeholders to sign up to them, and having them clearly recorded removes ambiguity about what you are setting out to do. The four basic steps to create useful success criteria are

  1. Document and agree the criteria; each criteria should include:
    1. The name of success criteria,
    2. How it is going to be measured,
    3. How often it is going to be measured, and
    4. Who is responsible for the measurement.
  2. Use continuous measurements where possible. For example, rather than ‘finish the project on time’ measure progress continually ‘no activity completes more than 5 days after its late finish date’.
  3. Baseline today’s performance.
  4. Track and report on your progress.

As with any performance indicators, the art is to select a few key measures that represent the wider picture if there are too many success criteria defined the impact will be severely reduced. For example, the effectiveness of meetings, communication and stakeholder attitude could be measured scientifically using the ‘Index Value’ in the Stakeholder Circle[8] or pragmatically by measuring the number of open issues against a target (eg, no more than 5 high priority open issues).

 

Summary

Goals and objectives are the building blocks required to allow the realisation value from the project’s outputs; they are essential ingredients in a successful project but are insufficient on their own.  The role of success criteria is to direct the way work at the project is accomplished so as to meet stakeholder expectations, and to craft a perception of success in the stakeholder’s minds.

Project success is an amalgam of value created for the organisation and your stakeholders being satisfied with the journey and the outcome.  This concept of success may seem subjective, but it does not have to be. Successful organisations work to take the guesswork out of this process by defining what success looks like and agreeing these definitions with the key stakeholders, so they all know when the project has achieved it.

This means the key to stakeholders perceiving your project as successful lays in understanding the criteria they will measure success by, incorporating those measures into your project success criteria, and then working to achieve the criteria. But even this is not enough, to engage your stakeholders you need to communicate the criteria, communicate your progress and communicate your success at the end. For more on effective communication see: http://www.mosaicprojects.com.au/PM-Knowledge_Index.html#PPM07

________________

 

[1] For more on the success or failure of the Sydney Opera House see Avoiding the Successful Failure!:  http://www.mosaicprojects.com.au/Resources_Papers_046.html

[2] For more on paradox see: https://www.projectmanagement.com/blog-post/30669/The-Problem-With-Paradox

[3] For more on differentiating projects and programs see: http://www.mosaicprojects.com.au/WhitePapers/WP1002_Programs.pdf

[4] For more on the project charter see: http://www.mosaicprojects.com.au/WhitePapers/WP1019_Charter.pdf

[5] For more on project success see: http://www.mosaicprojects.com.au/Mag_Articles/N001_Achieving_Real_Project_Success.pdf

[6] SMART = Specific, Measurable, Attainable, Relevant and Time-framed.

[7] For more on linking objectives and benefits see: http://www.mosaicprojects.com.au/WhitePapers/WP1042_Outputs_Outcomes_Benefits.pdf

[8] The Stakeholder Circle® index value see: http://202.146.213.160/help-files/stakeholder-engagement-profile/#engagement-index

4 Comments

Posted in Communication, General Project Management, Project Controls, Scope Management, Stakeholder Management, Value

Tagged , , , , , , , ,

Phronesis – A key attribute for project managers

Posted on May 21, 2017 by | 3 comments

Phronesis (Ancient Greek: φρόνησις, phronēsis) is a type of wisdom described by Aristotle in his classic book Nicomachean Ethics. Phronesis or practical wisdom[1] is focused on working out the right way to do the right thing in a particular circumstance. Aristotle understood ethics as being less about establishing moral rules and following them and more about performing a social practice well; being a good friend, a good manager or a good statesman. This requires the ability to discern how or why to act virtuously and the encouragement of practical virtue and excellence of character in others.  But in a post-truth world, the ability to use ‘practical wisdom’ to discern what is real and what is ‘spin’ in rapidly becoming a key social and business skill. So prevalent is this trend, the Oxford English Dictionary named ‘post-truth’ its 2016 word of the year.

This problem pre-dates Donald Trump and ‘Brexit’, but seems to be getting worse. How can a project manager work out the right way to do the right thing in the particular circumstance of her project when much of the information being received is likely to be ‘spun’ for a particular effect.  There may be a solution in the writings of Bent Flyvbjerg.

Professor Bent Flyvbjerg, Chair of Major Programme Management at the Saïd Business School, Oxford University, has a strong interest in both megaproject management and phronesis. A consistent theme in his work has been the lack of truthfulness associated with the promotion of mega projects of all types, worldwide and the consequences of this deception. To help with the challenge of cutting through ‘spin’, and based on his research, he has published the following eight propositions:

1. Truth is context dependent.
2. The context of truth is power.
3. Power blurs the dividing line between truth and lies.
4. Lies and spin presented as truth is a principal strategy of those in power.
5. The greater the power, the less the truth.
6. Power has deeper historical roots than truth, which weakens truth.
7. Today, no power can avoid the issue of ‘speaking the truth’, unless it imposes silence and servitude. Herein lies the power of truth.
8. Truth will not be silenced.

There is, of course, a book, Rationality and Power: Democracy in Practice[2] that goes into more detail but just thinking through the propositions can help you apply the practical ethics that underpin phronesis.  Being virtuous is never easy, but regardless of the power brought to bear, sooner or later the truth will be heard.

The problem is which ‘truth’, understanding and perception will influence what people see, hear and believe to be the truth. Nietzsche, a German counter-Enlightenment thinker of the late 19th century, suggests that objective truth does not really exist; that objective absolute truth is an impossibility. The challenge we all face is the practical one of understanding enough about ourselves and others (we are all biased[3]) to achieve a reasonable level of understanding and then do our best to make the right decisions (see more on decision making), and to do the right thing in the right way.

___________________

[1] From Practical Wisdom, the right way to do the right things by Barry Schwartz and Kenneth Sharp.  Riverhead Books, New York 2010.

[2] See: https://www.amazon.com/Rationality-Power-Democracy-Practice-Morality/dp/0226254518/

[3] See,  The innate effect of Bias:  http://www.mosaicprojects.com.au/WhitePapers/WP1069_Bias.pdf

3 Comments

Posted in Ethics

Tagged , , , , ,

How the chair can make a meeting ineffective

Posted on March 7, 2017 by | Leave a comment

The chair of any meeting has a unique ability to destroy the value of the meeting!

Eight of the key ways to reduce the meeting’s value are:

  1. Playing favourites. Bad chairs tend to shut down some attendees whilst allowing others they see as politically important to occupy most of the speaking time. The outcome from this behaviour tends to be poor decision-making; bad chairs don’t care. Their interest is to stay the good books of the people they see as politically important.
  2. Changing the rules. Bad chairs keep the rules to themselves and change the rules when it suits them. They don’t give advice on what preparation attendees need to make or advise how the meeting will be conducted. While this trait may appear to appear to be a gambit to leave the chair in control, in reality it means the meeting is likely to be less than useful.
  3. Showing bias. When there is a vigorous debate between various groups in the meeting a bad chair will obviously be supporting one side.  Good chairs remain neutral whilst they may feel strongly about subject their primary function is to ensure the meeting reaches a consensus, not that the meeting reaches a decision that they predetermine as being optimum (although they need to be part of the consensus).
  4. Failing to define its purpose. Bad chairs do not define a clear objective for the meeting, fail to set priorities, and don’t circulate an agreed agenda. Good chairs define the purpose of every meeting with crystal clarity so attendees can come prepared and stay focused.
  5. Losing control. The hallmarks of a bad chair during the meeting include running over time, getting off track, get rattled, and allowing discussion to descend into personal arguments. Good facilitators keep their hands firmly on the reins consistently and politely guiding discussion back to the purpose of the meeting.
  6. Failing to communicate. Bad chairs tend to display no sense of appreciation for the points made by contributors to the discussion and tend to ignore many of the attendees. Good chairs are great communicators remember everybody’s name, include newcomers, and are excellent at active listening and summarising points to ensure everybody has a clear understanding of the current state discussion[1].
  7. Failing to make decisions. Deadlocks happen in most meetings, bad chairs cannot solve them. A good chair will either take a vote, extend discussion for a set (limited) period, set up a working party, or call an extraordinary meeting to deal with the item later; any of these options are better than allowing the meeting to waffle on allowing tension and confusion to grow.
  8. Failing to engage with meeting participants outside of the meeting. Bad chairs are missing in action, too busy to be involved with the delegates other than during the meeting. Good chairs recognise the meeting is part of a continuing process that requires responsive input and support between meetings.

Meetings are an expensive resource often costing thousands of dollars an hour to run. If you are the chair of the meeting, or are responsible for calling a meeting, you need to ensure the meeting is managed effectively to maximise the opportunity for success.  This is important for every type of meeting from a short team ‘stand-up’ through to company board meetings – the further up the hierarchy the greater the cost of ineffective meetings. Unfortunately ‘bad chairs’ seem to be common at all levels; the idea for this post came from an article by Kath Walters in the AICD March 2017 magazine focused on the behaviour of dysfunctional boards of directors.

Recognising poor performance is one thing, doing something about it is another; for more on managing effective meetings see: http://www.mosaicprojects.com.au/WhitePapers/WP1075_Meetings.pdf

Meeting management and effective communication also feature in our PMP and CAPM courses – the next 5-day intensive course starts 20th March, see: http://www.mosaicproject.com.au/

_______________

[1] For more on active listening see: http://www.mosaicprojects.com.au/WhitePapers/WP1012_Active_Listening.pdf

Leave a comment

Posted in Communication

Tagged , , , , ,

The Yin and Yang of Integrated Data Systems

Posted on December 13, 2016 by | Leave a comment

Integrated project management information systems (PMIS) are becoming more common and more sophisticated ranging from ‘web portals’ that hold project data through to the potential for fully integrated design and construction management using BIM[1].  The benefits derived from using these systems can be as much as 20% of the build price on complex construction projects using BIM.

The advantages of this type of information storage and retrieval system include:

  • Ready access to data when needed via PDAs and ‘tablets’ significantly reducing the need for ‘push’ communication and the existence of ‘redundant data’[2].
  • One place to look for information with indexing and cross-referencing to minimise the potential for missed information.
  • Audit trails and systems to ensure only the latest version of any document is available.
  • Cross-linking of data in different documents and formats to assist with configuration management, requirements traceability, and change control.
  • Controls on who can ‘see’ the data, access the data and edit the data.
  • Workflow functions to remind people of their next job, list open actions, record actual progress, etc[3].
  • A range of built-in functions to validate data and avoid ‘clashes’, including locking or ‘freezing’ parts of the data set when that information has been moved into ‘work’.

These benefits are significant and a well-designed system reduces errors and enhances productivity leading to reduced costs, but the ‘yin’ of well-designed PMIS comes with a ‘yang’!

People increasingly tend to believe information produced from a computer system, this is true of ‘Facebook’, Wikipedia and flows through to more sophisticated systems. There also seems to be a steady reduction in the ability of younger people in particular to critically analyse information; in short, if it comes from the computer many people will assume it is correct. Add to this the ability of many of the more sophisticated PMIS tools to transpose and transfer information between different parts of the systems automatically or semiautomatically and there is a potential for many of the benefits outlined above to be undermined by poor data. This issue has been identified for decades and has the acronym GIGO – garbage in, garbage out.

The question posed in this blog is how many projects and project support organisations (PMOs, etc.) consider or actively implement effective data traceability.  Failed audits, overruns from scope oversights, and uninformed or ill-informed decision-making are just a few of the consequences project teams suffer from if they do not have full traceability of their project management data. This issue exists in any information processing system from basic schedule updating, through monthly reporting to the most sophisticated, integrated PMIS. If you cannot rely on the source data, no amount of processing will improve the situation! And to be able to rely on data, you need to be able to trace it back to its source.

Traceability is defined as ‘the ability to trace the location, history and use of each data element’. This sounds simple but in reality can be very challenging, and the results of poor visibility can be devastating to a project. Some of the key questions to ask are:

  • Where did this data or these actuals come from?
  • What is the authorizing document and when did it get signed/approved?
  • Has everyone approved the change request or action item?

Traceability does not happen by accident! Project management information systems have to be designed with traceability as a key element in each of its aspects.  As information comes into the system the author or the origin of the information has to be recorded (preferably automatically). Depending on the nature of the information it may need to be quarantined until appropriate checks have been carried out and/or approvals have been obtained and then there needs to be traceability of any subsequent changes. The foundation of traceability is the combination of processes (people) and data management.

Therefore, the ‘yang’ of a sophisticated integrated project management information systems is that as the systems become more integrated and sophisticated people will come to rely on the information provided and ‘trust it’ whilst the source and veracity of the data used becomes less obvious.

Resolving this is partly process and partly people. The Chartered Institute of Building (CIOB) has produced the Time and Cost Management Contract Suite 2015 focused on complex construction projects using BIM.  This contract defines a number of key support roles (largely independent of the parties) focused on managing the information flows into and out of the system to ensure its accuracy and validity. Similar roles and responsibilities are essential in any effective PMIS.

My latest post on the PMI ‘Voices blog’, From Data to Wisdom: Creating & Managing Knowledge highlights the importance of data as the underpinning of all reporting and communication.  So the question is, how much focus does your project team or PMO put on ensuring the data it is using is timely, complete, accurate and traceable?

____________________

[1] BIM = Building Information Modelling, see: http://www.mosaicprojects.com.au/WhitePapers/WP1082_BIM_Levels.pdf

[2] For more on planning project communication see: http://www.mosaicprojects.com.au/Mag_Articles/ESEI-09-communication-planning.pdf

[3] A discussion on how these capabilities can enhance project controls is at: /2016/11/26/the-future-of-project-controls/

Leave a comment

Posted in Communication, General Project Management, Project Controls

Tagged , , ,

The future of project controls

Posted on November 26, 2016 by | 36 comments

Last week I participated in two PUXX panel discussions in Perth and Sydney focused on predicting the influence of technology on project controls.  The range of subjects covered ranged from drones and remote monitoring to virtual reality.

Many of the topics discussed offered better ways to do things we already do, provided we can make effective use of the data generated in ever increasing quantities – significant improvements but essentially ‘business-as-usual’ done better. The aspect I want to focus on in this post is the potential to completely reframe the way project schedules are developed and controlled when existing ‘gaming technology’ and BIM are synthesised.

The current paradigm used for critical path scheduling is a (dumbed-down) solution to a complex set of problems required to allow the software to run on primitive mainframe computers in the late 1950s – the fundamentals have not changed since! See: A Brief History of Scheduling.

The underlying assumption is a project consists of a set of activities each with a defined duration and depending on the logical relationship between the activities, some are ‘critical’ others have ‘float’.  The basic flaw in this approach can be demonstrated by looking at the various options open to a schedule to define the work involved in 3 simple foundations involving excavation and mass concrete fill.

All four of the above options above are viable alternatives that may be chosen by different schedulers to describe the work using CPM, and none of them really describe what actually happens. The addition of more links would help but even then the real situation which is one resource crew visits three locations in turn and excavates the foundations, a second crew follows and places the concrete with some options for overlapping, parallel working and possibly synchronising the actual pouring of all three foundations on the same day…….. Optimising the work of the crews is the key to a cost effective outcome and this depends on what follows their work.  For more on resource optimisation see: www.mosaicprojects.com.au/Resources_Papers_152.html. Advances in computer software offer the opportunity to develop a new way of working.

The starting point for the hypothesis outlined I this post is 4D BIM (Building Information Modelling). Last month I was in London working on the final edits to the second edition of the CIOB’s book, Guide to Good Practice in the Management of Time in Complex Projects (due for publication in 2017 as The Management of Time in Major Projects). One of the enhancements in the second edition is an increased focus on BIM. To assist our work a demonstration of cutting edge 4D BIM was provided Freeform.

Their current capabilities include:

  • The ability to model in real time clashes in working space provided the space needed for each crews work is parameterised. Change the timing of one work crew and the effect on others in a space is highlighted.
  • The ability to view the work from any position at any time in the construction process; allowing things such as a tower crane driver’s actual line of sight to be literally ‘seen’ at different stages of the construction.
  • The relatively normal ability to import schedule timings from a range of standard tools to animate the building of the model, and the ability to feedback information derived from processes such as the identification of clashes in the use of working space using
  • The space occupied by temporary works and various pieces of equipment can be defined and clashes with permanent works identified over time.
  • Finally the ability for a person to see and move around within the virtual model using the same type of 3D virtual reality goggles used by many gaming programmes. The wearer is literally immersed in the model.

For all of this in action on a major rail project see: https://www.newcivilengineer.com/future-tech/pushing-the-limits-of-bim/10012298.article

Moving into the world of game playing, there are many different games that allow players in competition, or collaboration, to ‘build’ cities, empires, fortifications, farms, etc. These games know the resources available to the players and how many resources will be required to construct each new element in the game – if you don’t have the resources, you can’t build the new asset.

Combining these two concepts opens up the possibility for a completely new approach to scheduling physical projects that involve the deployment of resources to physical locations to undertake work. The concept of location-based scheduling is not new, it was used in the 1930s to construct the Empire State Building (see: Line of Balance) and is still widely used.  For more on location-based scheduling see: Location-Based Management for Construction: Planning, Scheduling, and Control by Prof. Russell Kenley.

How these concepts tie into BIM starts with the model itself.  A BIM model consists of a series of parameterised objects. Each object can contain data on its size, weight, durability, cost, maintainability, carbon footprint, etc. As BIM develops many of these objects will come from standard libraries created by suppliers and subcontractors. Change an object, for example, replace windows from manufacturer “A” with similar Windows from manufacturer “B” and the model is update and potential issues with sizes, fixings and waterproofing can be identified. It is only a small step from this point to add parameters related to the resources needed to undertake the work of installation.

With this information and relatively minor enhancements to current BIM capabilities, once the engineering model is reasonably complete a whole new paradigm for planning work opens up.

To plan the work the ‘planning team’ put on their virtual reality headsets and literally ‘walk’ onto the site.  As they start to locate temporary works and begin the building process the model is tracking the use of resources and physical space in real time. The plan is developed based on the embedded parameters in the fully integrated 3D model.

Current 4D imports a schedule ‘shows you’ the effect.  Using the proposed gaming approach and parameterized objects you can literally build the project in the virtual space and either see the consequences on resource loading or be limited by resource availability.  A whole bunch of games do this already, add in existing clash detection capabilities (but applied to workers using the space) and you change the whole focus of planning a project. Decisions can be made to adjust the size of resource crews and the flow of work can be optimised to balance the competing objectives of cost efficiency, time efficiency and resource optimisation.

The proposed model is a paradigm shift away from CPM and its arbitrary determination of activities and durations to a process focused on the smooth flow of resources through work areas. The computational base will be focused on resource effectiveness and resource utilisation. Change ‘critical path’ to ‘critical resources’, eliminate the illusion of ‘float’ but look for underutilised resources and resource waiting time. To optimise the work, different scenarios can be stored, replayed and edited – the ultimate ‘what-if’ experience.

The concept of ‘schedule density‘ ties in with this approach nicely; initial planning is done for the whole project at the ‘low density’ level with activity durations of several weeks or months setting out the overall ‘time budget’ for the project and establishing the strategic flow of work.  As the design improves and more information becomes available, the schedule is enhanced first to ‘medium density’ and then to ‘high density’. The actual work is controlled by the ‘high density’ part of the schedule. For more on ‘schedule density’ see: www.mosaicprojects.com.au/WhitePapers/WP1016_Schedule_Density.pdf.

Where this concept gets really interesting is in the control of the work.  The medium and high density elements of the schedule are built using the same ‘virtual reality’ process as the overall schedule, therefore each object in the overall BIM model can include data on the resources allocated to the work, the sequence of work and the time allowed. Given workers on BIM-enabled projects already use various PDAs to access details of their work, the same tablet or smart device can be used to tell the workers their next job and how long that have to complete it. When they complete the task, updating the BIM model with that progress information updates the schedule, tells the crew their next job and tells the next resources planned to move into the area that the space is available. The schedule and the 3D model are the same entity.

Similarly, off-site manufacturing and design lead-times can be integrated into the dataset.  Each manufactured item can have its design, manufacture and transport and approval times associated with the element making the development of an off-site works / procurement schedule a simple process to extract the report once the schedule is set.  Identifying delays in the supply chain and dealing with changes in the timing of installation become staigtforward.

When inevitable problems occur, the project management team have the ideal tool to work through solutions and determine the optimum way forward, as soon as the new schedule is agreed, the BIM model already holds the information.

One of the key concepts in ‘schedule density’ is that any work planned for the short-term future has to be based on the actual performance of the crews doing the work. In a BIM enabled scheduling system this can also be automated. The work content of each activity is held in the model as is the crew assigned to the work. As soon as the work crew’s productivity can be measured, the benchmark values used in the original planning can be updated with real data. Where changes in performance are needed to deal with slippages and productivity issues these can be properly planned and incorporated into the schedule based on when the implemented changes can be expected to occur.

I’m not sure if this is BIM2 or BIM++ but these ideas are not very far in advance of current capabilities – all we need now is a software developer to take on the ideas and make them work.

These concepts will be harder to apply to ‘soft projects’ but the planning paradigms in soft projects have already been shaken up by Agile. But integrating 3D modelling with an integrated capability for real 4D interaction certainly seem to make sense for projects where the primary time management issue is the flow of resources in the correct sequence through a defined series of work locations in three dimensions.   What do you think???

36 Comments

Posted in CIOB, Project Controls, Scheduling

Tagged , , , , , , ,

Are you a workshop leader or facilitator?

Posted on November 17, 2016 by | Leave a comment

Workshops are a routine feature in many projects. They are typically used either to find a solution to a problem or to develop and integrate knowledge needed for the work (eg, requirements gathering and prioritisation).

Effective project managers know that every workshop is a meeting and many of the rules for running effective meetings need to be applied including:

They also know that unlike normal meetings workshops are a creative process that needs the active contribution of the attendees to craft the best answer to the problem or question being posed…..  This means time is needed to ‘break the ice’ so that the people in the workshop feel comfortable working together and the facilitator needs to act as a host welcoming and engaging people as they arrive.

The job of the facilitator is to ensure the workshop ‘works’ and produces the required outcomes. The facilitator (or workshop leader) only needs sufficient knowledge of the subject under discussion to allow them to ask pertinent questions and summarise discussion – the core skills of facilitation lay in ensuring everyone is engaged and participates, all points of view are heard, the group works towards a consensus or conclusion efficiently and the outputs are agreed.  For more on facilitation see: http://www.mosaicprojects.com.au/WhitePapers/WP1067_Facilitation.pdf

Facilitation is a very useful skill for a project manager to acquire and use, however, to organise and run a successful workshop there are a two key questions that need to be asked very early in the planning stage – unfortunately both of these are frequently overlooked!

Question 1 – Will I be a key contributor to the process of developing the workshop’s output? If the answer to this question is ‘yes’ the project manager should consider engaging someone else to act as the facilitator for the workshop.  The role of the facilitator is to make sure everyone contributes, all of the ideas are brought into discussion and the best solution is reached; it is nearly impossible to do this if you are also contributing significant input to the discussion.

Question 2 – Do I want to lead the workshop towards a predetermined conclusion or do I want the workshop to have free reign to explore and develop its own solutions?  While a degree of flexibility is needed in both situations, if the workshop is focused on getting buy-in to a concept that is already in mind (quite common in problem solving mode) the approach to managing the workshop will be quite different to an open discussion looking at all of the options.

Based on your answers to these questions there are four quite different types of workshop that require different approaches to deliver successful outcomes:

The best way to approach the planning and running each of these workshop types varies significantly.

You facilitate. In situations where you have no particular input to contribute and no predetermined outcome in mind (beyond the fact you need an outcome) facilitating the work of the group participating in the workshop can be a good way to build credibility and enhance your leadership position. Provided you are comfortable in the role, facilitating the workshop to achieve a useful outcome is a valid role for the project manager.  If you are not comfortable in the role, there is nothing wrong with using an experienced facilitator, your objective is simply to get a useful outcome from the process (for example a prioritised list of requirements).

Others facilitate. Where you are going to be a key participant in the workshop process and have significant input to contribute as a subject matter expert, but do not want to drive to a predetermined conclusion, the use of a neutral facilitator is essential.  The job of the facilitator is to ensure all of the viewpoints in the room are heard and the outcomes from the workshop incorporate the views of the participants, either based on a consensus or by applying an impartial selection / decision making process. It is virtually impossible to simultaneously be a participating expert and an impartial facilitator.

Briefing sessions. Have a very different focus, the purpose of the workshop is to explore and understand a predetermined proposition.  The role of the facilitator shifts towards making sure everyone’s questions are heard and answered, and there is a full understanding of the proposition being put. The outcome from the workshop is focused on creating understanding and buy-in from the participants rather than crafting a free-form solution – depending on the nature of the proposition being discussed, there may, or may not, be opportunities to adjust or fine-tune the concepts. However, provided someone else is the primary source of the concepts being discussed, the project manager can usefully take the role of facilitator.

Sales sessions. Have a similar focus to briefing sessions but the concept being ‘sold’ is primarily ‘owned’ by the project manager.  In this situation if you want genuine buy-in from the workshop participants it is essential that the workshop is facilitated by someone else!  The facilitator’s job is to make sure everyone is heard and to help lead the group towards a common understanding and consensus. Your job is to answer the questions and ‘sell’ the proposition (and where appropriate adapt your proposition based on the feedback received).

Understanding the objectives of the workshop and the best way for you to participate in delivering a successful outcome lays the foundation for success.  Then the hard work starts……..

Leave a comment

Posted in Communication, General Project Management

Tagged , , , ,

Seeking a definition of a project.

Posted on August 11, 2016 by | 16 comments

Good definitions are short and unambiguous and are essential for almost every aspect of life. Even something as simple as ordering a snack requires a clear understanding of what’ required – this understanding is the basis of a definition. For example, doughnuts and bagels have a lot in common, they are both round and have a hole (a torus), and are made from dough but they are ‘definitely’ very different commodities! If you need a bagel for breakfast or a doughnut for you coffee everyone involved in the transaction needs to understand your requirements if your expectations are to be fulfilled.

 

 

 

 

 

The simple fact is if you cannot define something precisely, you have real problems explaining what it is, what it does and the value it offers, and this lack of definition/understanding seems to be a key challenge facing the project management community (by the way, the bagel is on the left…… the other picture is a Krispy Kreme donut).

Definitions serve two interlinked purposes, they describe the subject of the definition in sufficient detail to allow the concept to be recognised and understood and they exclude similar ‘concepts’ that do not fit the definition. Definitions do not explain the subject, merely define it.

Way back in 2002 we suggested the definition of ‘a project’ was flawed. Almost any temporary work organised to achieve an objective could fit into almost all of the definitions currently in use – unfortunately not much has changed since. PMI’s definition of a ‘project’ is still a: temporary endeavour undertaken to create a unique product, service or result. This definition is imprecise, for example, a football team engaged in a match is involved in:

  • A temporary endeavour – the match lasts a defined time.
  • Undertaken to create a unique result – the papers are full of results on the weekend and each match is unique.
  • Undertaken to create a unique product or service – the value is in the entertainment provided to fans, either as a ‘product’ (using a marketing perspective) or as a service to the team’s fans.

Add in elements from other definitions of a project such as a ‘defined start and end’, ‘planned sequence of activities’, etcetera and you still fail to clearly differentiate a team engaged in a project from a football team engaged in a match; but no-one considers a game of football a project. Football captains may be team leaders, but they are not ‘project managers’.

The definition we proposed in 2002 looked at the social and stakeholder aspects of a project and arrived at an augmented description: A project is a temporary endeavour undertaken to create a unique product, service or result which the relevant stakeholders agree shall be managed as a project. This definition would clearly exclude the football team engaged in a match unless everyone of significance decided to treat the match as a project but still suffers from a number of weaknesses. To see how this definition works download the 2002 paper from, www.mosaicprojects.com.au/PDF_Papers/P007_Project_Fact.pdf

 

Updating the definition

Since 2002 there has been a significant amount of academic work undertaken that looks at how projects really function which may provide the basis for a better definition of a project.  The key area of research has been focused on describing projects as temporary organisations that need governing and managing; either as a standalone organisation involving actors from many different ‘permanent organisations’ such as the group of people assembled on a construction site, or as a temporary organisation within a larger organisation such a an internal project team (particularly cross-functional project teams). The research suggests that all projects are undertaken by temporary teams that are assembled to undertake the work and then dissipate at the end of the project.

My feeling is recognising the concept of a project as a particular type of temporary organisation provides the basis for a precise and unambiguous definition of ‘a project’. But on its own this is insufficient – whilst every project involves a temporary organisation, many temporary organisations are not involved in projects.

Another fundamental problem with the basic PMBOK definition is the concept of an ‘endeavour’.  The definition of endeavour used as a noun is: an attempt to achieve a goal; as a verb it is: try hard to do or achieve something.  But, ‘making an effort to do something’ is completely intangible; projects involve people! Hitting a nail with a hammer is an endeavour to drive it into a piece of wood but this information is not a lot of use on its own; you need to know who is endeavouring to drive the nail and for what purpose?

Another issue is the focus on outputs – a product service or result; the output is not the project, the project is the work needed to create the output. Once the output is finished, the project ceases to exist!  A building project is the work involved in creating the building, once the building is finished it is a building, not a project. But confronted with the need to create a new building different people will create different projects to achieve similar results:

  • One organisation may choose to create two projects, one to design the building, another to construct it;
  • A different organisation may choose to create a single ‘design and construct’ project;
  • Another organisation may simply treat the work as ‘business as usual’.

The scope of the work involved in any particular project is determined by its stakeholders – projects are a construct created by people for their mutual convenience, not by some immutable fact of nature.

 

A concise definition of a project

Unpacking the elements involved in a project we find:

  • A temporary organisation is always involved, but not all temporary organisations are project teams.
  •  Projects cause a change by creating something new or different – this objective defines the work to be accomplished and usually includes constraints such as the time and money available for the work. These requirements and scope of work included in a project have to be defined and agreed by the relevant stakeholders at some point – there are no pre-set parameters.
  • The stakeholders have to agree that the work to accomplish the scope will be managed as ‘a project’ for the project to exist; the alternative is ‘business as usual’ or some other form of activity.

Modifying our 2002 definition to incorporate these factors suggests a definition along these lines:

A project is a temporary organisation established to deliver a defined set of requirements and scope of work, which the relevant stakeholders agree shall be managed as a project.

The definition originally proposed has been updated based on discussions with colleagues to:

Project:  A temporary organisation established to accomplish an objective, under the leadership of a person (or people) nominated to fulfil the role of project manager.

Project manager: A person (or people) appointed to lead and direct the work of  a project organisation on behalf of its stakeholders, to achieve its objective. The job title and the degree of authority and autonomy granted to the project manager are determined by the governance arrangements established by the project’s stakeholders.

Project management: The application of knowledge, skills tools and techniques to lead and direct the work of a project organisation.

This definition overcomes many of the fundamental problems with the existing options:

  • It recognises projects are done by people for people, they are not amorphous expenditures of ‘energy’.
  • It allows for the fact that projects do not exist in nature, they are ‘artificial constructs’ created by people for their mutual convenience, and different people confronting similar objectives can create very different arrangements to accomplish the work.
  • It recognises that projects are only projects if the people doing the work and the people overseeing the work decide to treat the work as a project.  The ‘always present’ factors are:
    • People decide to call the work a project (but just calling it a project is not enough)
    • The work is directed to achieving an objective that involves a change in something (new, altered, improved, demolished, etc)
    • The people doing the work are part of a temporary organisation (team / contract / ad hoc / etc) created to facilitate achieving the objective.
    • The work is led by a person fulfilling the role of a project manager and the work is managed as a project (PMBOK / ISO 21500 / Agile / etc).

What do you think a good project definition may be that is concise and unambiguous?

The challenge is to craft a technically correct definition, and then apply the Socratic method of thinking outlined in our 2002 paper at:  www.mosaicprojects.com.au/PDF_Papers/P007_Project_Fact.pdf.

I look forward to your thoughts!

16 Comments

Posted in General Project Management, Governance

Tagged , , , , , ,

Selling Change – lessons from Brexit

Posted on June 30, 2016 by | 6 comments

Is the reason so many change initiatives fail an excessive focus on the ‘technical benefits’ and future value?  Some of the lessons from the Brexit campaign would suggest ‘YES’!

Before people will buy into a new opportunity (the ‘change’) it helps if they are unhappy with the status quo.  If this unhappiness can be magnified the willingness to embrace an uncertain future can be increased.  The Brexit ‘Leave campaign’ is an extreme example of creating this desire. Most of the focus of ‘Leave campaign’ seems to have been tailored towards raising the level of unhappiness with the status quo. A few key examples:

EU bureaucracy – it exists and it is a significant burden; by simply focusing on the ‘perceived pain’ (most electors have very little contact with the regulations) a desire to leave was generated. The counter points carefully ignored include:

  1. If the UK leaves it will need its own regulations for public health and safety
  2. Firms that want to export to Europe will have more bureaucracy to deal with, complying with both the UK rules and the EU rules (the alternative is to cut off 50% of your export market).

EU bureaucrats – the unelected and unaccountable masses in Brussels!  This ignores the fact UK bureaucrats are unelected and both sets are accountable to their respective parliaments.  However, the perception of lack of control and accountability was significant despite the fact 99% of the UK electors have no control over UK bureaucrats.

Immigration and Islam. ‘Taking control of UK borders’ seemed to be the biggest factor in the debate.  It’s a nice idea that ignores history:

  1. The vast majority of Islamic migrants in the UK arrived before the UK joined the EU (or these days their parents arrived…). Until the 1960s Commonwealth citizens had UK passports and a right of residence in the UK.
  2. The EU is less than 5% Islamic.
  3. Freedom to work in the EU is a two-way process – the right to work and access to workers is important (and has virtually nothing to do with ‘immigration’).

Trade deals. Negotiating ‘trade deals’ to the benefit of the UK…..   Ignoring the fact that any trade deal requires concessions and most take 5 to 10 years to negotiate. The ‘other party’ has to see a significant benefit.

 

Lessons from Brexit!

The positive lesson for change proponents is to spend more time on creating the desire for change. Most people in an organisation can ‘live with’ the status quo (but are aware of the problems and pain points), and are likely to be frightened with the perceived threats and challenges of the proposed change.  Digging into the ‘pain points’ and offering constructive solutions may provide a powerful basis for building the desire for change.  This is a very different approach to starting with an emphasis on the future benefits and opportunities the proposed change will bring.

The processes needed to sell the change to the organisation’s executive decision makers have to focus on benefits and value, but Brexit suggests a different approach may be beneficial when approaching the people within the organisation affected by the change.

Ethics matter!  “You can fool all the people some of the time and some of the people all the time, but you cannot fool all the people all the time[1]”. What has yet to wash out in the Brexit aftermath is the lack of ethics and in some cases blatant dishonesty of the ‘Leave campaign’. I suspect there will be a major backlash against the people responsible for the ‘Leave campaign’ as people become aware of the exaggerations and deceptions.  The current crash in the Pound and the almost inevitable recession it will cause were predicted.  What was missed from the UK debate, and is essential in an organisational change initiative, is recognition of the challenges of the change – offset by the vision of future benefits. Ethics are not negotiable!

Simple language is important.  Creating and emotional commitment to change requires the use of language that is easy to understand. The ‘Leave vision’ was simplistic rather than simple but it worked – ‘make Britain great again’ and ‘regain sovereignty’ sound appealing[2] but lack substance.  The difference between the Brexit ‘con job’ and ‘informed consent’ is understanding what you are committing to, both the vision and the journey. But the language of projects, engineers and technicians used to define and develop a change proposal is frequently inappropriate for effective communication to the rest of the people affected.  This is discussed in my paper: Understanding Design – The challenge of informed consent.

Summary

The Brexit campaign is an extreme example of creating a desire for change based on developing a level of dissatisfaction with the status quo.  This tactic can be a very useful early phase in the communication processes around a proposed organisational change – dissatisfaction with the current state is a powerful driver to accept change.  The flip side, also observable in the Brexit campaign, is that ethics and honesty matter. Democracy requires informed consent!  We have no idea what the consequences in the UK would have been if the ‘Leave campaign’ had been more ethical and spelt out a future; but judging from the reaction of many, large numbers of people now seem to feel conned by the ‘leave’ campaign.

In an organisational context, this loss of trust will be disastrous.  However, the fact the ‘Leave campaign’ could persuade a majority in the UK to vote in favour of an uncertain future that will reduce living standards and increase costs in the short-term (at least) without even bothering to paint a clear vision of their proposed future (or how to get there) shows how powerful the techniques discussed above can be.

The challenge for ethical organisational change is to harness the power without resorting to the deceptions.

 

[1] Adapted from: “Traité de la Vérité de la Religion Chrétienne” by Jacques Abbadie (1684, Chapter 2)

[2] Britain was ‘Great’ in the period leading up to WW1 based on its Empire (not the Commonwealth); it is and has been a sovereign nation since 1066…… Neither of these concepts was fleshed out possibly allowing 1000s of different self-made visions to fill the space. Potentially a good tactic but fraught with problems going forward.

6 Comments

Posted in Change Management

Tagged , , , , , ,

Stakeholders and Reputational Risk

Posted on April 25, 2016 by | 1 comment

Your reputation and your organisation’s reputation are valuable assets. The willingness of others to trust you, their desire to work with you and virtually every other aspect of the relationship between you and your stakeholders is influenced by their perception of your reputation (see more on The value of trust).  But reputations are fragile: they can take a lifetime to build and seconds to lose. Some of the factors influencing them are:

  1. Reputation cannot be controlled: it exists in the minds of others so it can only be influenced, not managed directly.
  2. Reputation is earned: trust is based on consistent behaviour and performance.
  3. Reputation is not consistent: it depends on each stakeholder’s view. One organisation can have many different reputations, varying with each stakeholder.
  4. Reputation will vary: each stakeholder brings a different expectation of behaviour or performance and so will have a distinct perception of reputation.
  5. Reputation is relational: you have a reputation with someone for something. The key question is therefore: ‘with whom, for what?’
  6. Reputation is comparative: it is valued in comparison to what a particular stakeholder experiences or believes in relation to peers, performance and prejudice.
  7. Reputation is valuable: but the true value of reputation can only be appreciated once it is lost or damaged.

Estimating the ‘true value’ of your reputation is difficult and as a consequence decisions on how much to invest in enhancing and protecting your reputation becomes a value judgment rather than a calculation. Your reputation is created and threatened by both your actions and their consequences (intended or not).  Some actions and their effects on your reputation are predictable, others are less so and their consequences, good or bad are even less certain. This is true regardless of your intention; unexpected outcomes can easily cause unintended benefit or damage to your reputation.

Building a reputation requires hard work and consistency; the challenge is protecting your hard earned reputation against risks that can cause damage; and you never know for sure what will cause reputational damage until it is too late – many reputational risks are emergent.

Managing Reputational Risk in Organisations

Because an organisation’s reputation is not easy to value or protect, managing reputational risk is difficult! This is particularly true for larger organisations where thousands of different interactions between staff and stakeholders are occurring daily.

The first step in managing an organisation’s reputational risk is to understand the scope of possible damage, as well as potential sources and the degree of possible disruption. The consequence of a loss of reputation is always the withdrawing of stakeholder support:

  • In the private sector this is usually investor flight and share value decline; these can spiral out of control if confidence cannot be restored.
  • In the public sector this is typically withdrawal of government support to reflect declining confidence.
  • In the professional sector client confidence is vital for business sustainability; a loss of reputation means a loss of clients.

Each sector can point to scenarios where the impact of reputation damage can vary from mild to catastrophic; and whilst the consequences can be measured after the effect they are not always predictable in advance.  To overcome this problem, managing reputation risk for an organisation requires three steps:

  • Predict: All risk is future uncertainty, and an appropriate risk forecasting system to identify reputation risk is required – creative thinking is needed here! The outcomes from a reputational risk workshop will be specific to the organisation and the information must feed directly into the governance process if reputation risk is to be taken seriously (see more on The Functions of Governance).
  • Prepare: Reputation risk is a collective responsibility, not just the governing body’s. All management and operational staff must recognise the organisation’s reputation is important and take responsibility for protecting it in their interaction with stakeholders. The protection of reputation should also be a key element in the organisation’s disaster recovery plans.
  • Protect: A regular vulnerability review will reveal where reputation risk is greatest, and guide actions to prevent possible damage. Each vulnerability must be assessed objectively and actions taken to minimise exposure. Significant risks will need a ‘protection plan’ developed and then implemented and monitored.

Dealing with a Reputational Risk Event

When a risk event occurs, some standard elements needs to be part of the response for individuals and organisations alike. For reputation enhancing risk events, make sure you acknowledge the ‘good luck’ in an appropriately and take advantage of the opportunity in a suitably authentic way. Over-hyping an event will be seen as unauthentic and have a negative effect on reputation; but good news and good outcomes should be celebrated. Reputation threatening risk events need a more proactive approach

  • Step 1: Deal with the event itself. You will not protect your reputation by trying to hide the bad news or ignoring the issue.  Proactively work to solve the problem in a way that genuinely minimise harm for as many stakeholders as possible minimises the damage that has to be managed.
  • Step 2: Communicate. And keep communicating – organisations need to have a sufficiently senior person available quickly as the contact point and keep the ‘news’ coming. Rumours and creative reporting will always be worse then the fact and will grow to fill the void. All communication needs to be open, honest and as complete as possible at the time.  Where you ‘don’t know’ tell people what you are doing to find out. (see Integrity is the key to delivering bad news successfully).
  • Keep your promises and commitments. If this becomes impossible because of changing circumstances tell people as soon as you know, don’t wait for them to find out.
  • Follow up afterwards. Actions that show you really care after the event can go a long way towards repairing the damage to your reputation.

Summary

Reputation is ephemeral and a good reputation is difficult to create and maintain. Warren Buffet in his 2015 memo to his top management team in Berkshire Hathaway emphasised that their top priority must be to ‘zealously guard Berkshire’s reputation’. He also reminded his leadership team that ‘we can afford to lose money–even a lot of money. But we can’t afford to lose reputation–even a shred of reputation’ (discussed in Ethics, Culture, Rules and Governance). In the long run I would suggest this is true for every organisation and individual – your reputation is always in the minds of other people!

1 Comment

Posted in Ethics

Tagged , , , , , , ,

Project Risk Management – how reliable is old data?

Posted on January 28, 2016 by | 5 comments

One of the key underpinnings of risk management is reliable data to base probabilistic estimates of what may happen in the future.  The importance of understanding the reliability of the data being used is emphasised in PMBOK® Guide 11.3.2.3 Risk Data Quality Assessment and virtually every other risk standard.

One of the tenets underpinning risk management in all of its forms from gambling to insurance is the assumption that reliable data about the past is a good indicator of what will happen in the future – there’s no certainty in this processes but there is degree of probability that future outcomes will be similar to past outcomes if the circumstances are similar. ‘Punters’ know this from their ‘form guides’, insurance companies rely on this to calculate premiums and almost every prediction of some future outcome relies on an analogous interpretation of similar past events. Project estimating and risk management is no different.

Every time or cost estimate is based on an understanding of past events of a similar nature; in fact the element that differentiates an estimate from a guess is having a basis for the estimate! See:
–  Duration Estimating
–  Cost Estimating

The skill in estimating both normal activities and risk events is understanding the available data, and being able to adapt the historical information to the current circumstances. This adaptation requires understanding the differences in the work between the old and the current and the reliability and the stability of the information being used. Range estimates (three point estimates) can be used to frame this information and allow a probabilistic assessment of the event; alternatively a simple ‘allowance’ can be made. For example, in my home state we ‘know’ three weeks a year is lost to inclement weather if the work is exposed to the elements.  Similarly office based projects in the city ‘know’ they can largely ignore the risk of power outages – they are extremely rare occurrences. But how reliable is this ‘knowledge’ gained over decades and based on weather records dating back 180 years?

Last year was the hottest year on record (by a significant margin) as was 2014 – increasing global temperatures increase the number of extreme weather events of all types and exceptionally hot days place major strains on the electrical distribution grids increasing the likelihood of blackouts.  What we don’t know because there is no reliable data is the consequences.  The risk of people not being able to get to work, blackouts and inclement weather events are different – but we don’t know how different.

Dealing with this uncertainty requires a different approach to risk management and a careful assessment of your stakeholders. Ideally some additional contingencies will be added to projects and additional mitigation action taken such as backing up during the day as well as at night – electrical storms tend to be a late afternoon / evening event. But these cost time and money…..

Getting stakeholder by-in is more difficult:

  • A small but significant number of people (including some in senior roles) flatly refuse to accept there is a problem. Despite the science they believe based on ‘personal observations’ the climate is not changing…….
  • A much larger number will not sanction any action that costs money without a cast iron assessment based on valid data. But there is no valid data, the consequences can be predicted based on modelling but there are no ‘facts’ based on historical events……..
  • Most of the rest will agree some action is needed but require an expert assessment of the likely effect and the value proposition for creating contingencies and implementing mitigation activities.

If it ain’t broke, don’t fix it???? 

The challenge facing everyone in management is deciding what to do:

  • Do nothing and respond heroically if needed?
  • Think through the risks and potential responses to be prepared (but wait to see what actually occurs)??
  • Take proactive action and incur the costs, but never being sure if they are needed???

There is no ‘right answer’ to this conundrum, we certainly cannot provide a recommendation because we ‘don’t know’ either.  But at least we know we don’t know!

I would suggest discussing what you don’t know about the consequences of climate change on your organisation is a serious conversation that needs to be started within your team and your wider stakeholder community.

Doing nothing may feel like a good options – wait and see (ie, procrastination) can be very attractive to a whole range of innate biases. But can you afford to do nothing?  Hoping for the best is not a viable strategy, even if inertia in your stakeholder community is intense. This challenge is a real opportunity to display leadership, communication and  negotiation skills to facilitate a useful conversation.

5 Comments

Posted in Communication, Risk, Stakeholder Management

Tagged , , , , , ,