|
Developing and Testing Changes
| Q: |
 |
Our team is enthusiastic but we do not know where to start. How do we know what changes to test? |
A:
|
 |
Change concepts are often useful for generating ideas for specific process changes. Sometimes, however, process changes can be identified first. Other sources of ideas for changes include brainstorming with the team, asking front-line staff and patients how they perceive the problem, talking with other departments that may have similar process issues, etc. |
Return to top of page
|
|
|
| Q: |
 |
What should we tell the staff in our unit when they say, "We have tried to change things before, but nothing has worked?" |
A:
|
 |
Try to identify why previous efforts have failed: separate out whether the idea was flawed or the attempt to implement it ran into barriers. Emphasize that teams often learn more from failed tests than from successes. Remember that you will be testing small changes first, so you will be able to identify and adjust to problems as they come up. |
Return to top of page
|
|
|
| Q: |
 |
How do we settle the disagreement on our team about which changes to make first? |
A:
|
 |
Remember that you will be testing ideas for change, so you can learn quickly about which approaches seem to work. Plan to test several ideas at once. Use multivoting or other group process tools to make a quick decision about where to start; revisit your decision after you have completed initial testing. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if we know what changes we would like to make, but we are afraid the resources we need are not available to us? |
A:
|
 |
Share plans with your senior leader and get initial feedback; be specific about the skills and/or resources the team needs. Test on a small scale to see if plans work before making a formal request for resources. Use small-scale data collection to minimize additional resources needed. Consider redefining the scope of the project if resources are an impediment; set initial aims for one department or one unit. |
Return to top of page
|
|
|
| Q: |
 |
Our front line staff is already overworked. How can we ask them to do something new? |
A:
|
 |
Ask senior management to provide additional resources for these individuals. Make the work a normal part of their day. Try to design changes that make everyday work easier rather than more difficult (e.g., consolidate different reporting forms). Identify opportunities to eliminate wasted efforts and unnecessary work. Make sure front-line staff is involved in designing changes. |
Return to top of page
|
|
|
| Q: |
 |
Our PDSA cycles sometimes take several weeks to complete. How can we speed things up? |
A:
|
 |
Large PDSA cycles are often difficult to complete, absorbing time and energy. Cycles should be short but significant; test a big idea on a small scale and in a short time frame (for example, on the next ten patients In the ICU; on Dr. Smith's patients next Tuesday) so that you can identify ways to improve or change the idea. |
Return to top of page
|
|
|
| Q: |
 |
We have done several PDSA cycles but we feel like we are losing our focus. What’s wrong? |
A:
|
 |
In reflecting on what was learned from the test ("Study"), make sure it helps to achieve your aim. Plot outcome measures related to the aim over time. |
Return to top of page
|
|
|
| Q: |
 |
How can we make sure that one PDSA cycle is linked to the next? |
A:
|
 |
The "Study" phase of one cycle should be connected to the "Plan" phase of the next one. Schedule specific times for reflecting on what was learned in carrying out cycles. |
Return to top of page
|
|
|
| Q: |
 |
Do we really have to document every step of a PDSA cycle? |
A:
|
 |
Documenting all four steps of a PDSA cycle — Plan, Do, Study, Act — has three clear benefits: It helps teams get into the habit of doing all the steps. It is often the only way to follow the thread of the improvement story. It also really helps in "bragging" or creating a coherent demonstration of progress for the future, for senior leaders, or for funders. |
Return to top of page
|
|
|
| Q: |
 |
Why do we need to make a prediction for every cycle we test? |
A:
|
 |
Teams often forget to predict. As Deming says, "Learning depends on having a theory." A prediction is the team’s theory about what will happen if this change is tested. Without a prediction, it is hard for a team to assess whether learning occurred or to compare what they expected to what happened. |
Return to top of page
|
|
|
| Q: |
 |
How do we identify the correct primary outcome measure for our team? |
A:
|
 |
Use the aim as a reference for defining the outcome measure. Aims should specify clear goals that reflect the change in the system. One approach is to define what you would like the results to show at the end of the project, and derive appropriate measures. |
Return to top of page
|
|
|
| Q: |
 |
What is the difference between outcome and process measures? |
A:
|
 |
Outcome measures tell whether the changes being made are leading to improvement — that is, helping to achieve the aim (e.g., waiting time in emergency department). Process measures tell whether a specific process change is having the intended effect (e.g., percent of telemetry patients not meeting criteria for telemetry utilization). |
Return to top of page
|
|
|
| Q: |
 |
We are concerned that we are tracking too many measures each month. How do you know how many measures you need? |
A:
|
 |
Make sure that measures match aims. Select a few measures that you will track throughout the project. Evaluate whether you need additional measures to help guide changes. Collect only enough data to support the "Study" phase of PDSA cycles. |
Return to top of page
|
|
|
| Q: |
 |
How much data do we need to collect to see if a PDSA cycle works or to evaluate progress toward the aim? |
A:
|
 |
Just enough — that is, just enough data to see if an improvement occurred. What matters is testing under a wide variety of conditions with multiple cycles. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if our information services department says it cannot run the report we need for our measures until three months from now? |
A:
|
 |
Use sampling instead of waiting for information services to crunch numbers. You can compare the results from sampling with those for all patients at a later time. |
Return to top of page
|
|
|
| Q: |
 |
We do not have an electronic way to capture the data we need for our measures. What should we do? |
A:
|
 |
Use the resources available to you. Paper and pencil are good enough. Updating the organization’s computer system is not a feasible endeavor for a short-term project; a great deal of change and improvement can occur using available resources and just enough data. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if no one seems interested in the data we are collecting? |
A:
|
 |
Check on the clarity of and commitment to the aim. Present data simply (use graphs rather than tables). Do not collect too much data. Check whether the data help with PDSA cycles; if not, you are probably collecting the wrong data. |
Return to top of page
|
|
|
| Q: |
 |
How can we overcome resistance on the part of staff we are relying on to collect and analyze our data? |
A:
|
 |
Make sure everyone has bought into the aims of the project and that the data reflect those aims. Show results of data collection to staff on a daily basis. Make sure the staff understands that data will be used for learning and improvement, not for judgment. Check whether you are collecting too much data, unnecessary data, or both. Make it easy for staff to collect data by integrating it into their daily routine. |
Return to top of page
|
|
|
| Q: |
 |
It seems like we spend all our time and energy either collecting or discussing data. What should we do? |
A:
|
 |
Emphasize using data in a test, with the focus on how data can guide the next PDSA cycle. Force an answer to the question, "What action could these data lead to?" Mandate a minimum data set and stick with it for a month. Suggest trying a PDSA cycle using existing data. |
Return to top of page
|
|
|
| Q: |
 |
The epidemiologist on our team says that our plan to collect a small amount of data will give us unreliable results. What should we say? |
A:
|
 |
Differentiate between the level of data sophistication needed for research and that needed for improvement. Randomized clinical trials are needed to establish standards of practice, but not to test best methods for putting standards into practice. Use sampling to test changes on a small scale; once you agree on improvements, you can collect additional data to verify results. Sampling is based on scientific principles and can satisfy many concerns about validity. |
Return to top of page
|
|
|
Forming and Running Teams
| Q: |
 |
What can we do to make our team meetings more focused and productive? |
A:
|
 |
Revisit the basics: aim, measures, and changes. Structure meetings around the Plan-Do-Study-Act (PDSA) cycles being tested. Visit other teams to see how their meetings work. Take advantage of the organization’s resources for facilitators or training in team building. Consider changing the team membership if problems persist. Do a PDSA cycle that focuses on improving team functioning. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if our team members agree on what is to be done, but don't follow through? |
A:
|
 |
Check the composition of the team; it should include systems, day-to-day, and technical leadership. A missing component can hamper implementation. Clarify the specific responsibilities of individuals and the time frames for completion. Investigate if the staff just does not have time to complete responsibilities; discuss with the team and with the senior leader. |
Return to top of page
|
|
|
| Q: |
 |
How can we shorten our team meetings but still accomplish everything we need to do to keep the improvements going? |
A:
|
 |
Establish team rules regarding agenda-setting, timekeeping, roles, and responsibilities. Make sure each meeting has a clear focus and objectives. Use PDSA cycles to test ways to shorten meetings. Use brief huddles between meetings to keep in touch and report on progress. Scale down the project based on time constraints. |
Return to top of page
|
|
|
| Q: |
 |
What can we do if our team never seems to be able to hold regular meetings? |
A:
|
 |
Investigate whether the issue is lack of time or lack of a focus. If time is the issue, discuss resource availability with the senior leader; have other staff cover during meetings; have meetings before or after a shift. If lack of focus is the issue, revisit aims, and plan for testing changes. Schedule the next meeting at the beginning of each meeting. Use brief team huddles between meetings. |
Return to top of page
|
|
|
Organizational Change Issues
| Q: |
 |
How can we address interdepartmental barriers to change? |
A:
|
 |
Bring staff from other departments into the project; have staff from one department visit the other. Make patient care goals a priority. Seek the assistance of the senior leader. |
Return to top of page
|
|
|
| Q: |
 |
How can we overcome staff resistance to change? |
A:
|
 |
Work with those who will work with you. Communicate goals and progress throughout the project. Building relationships is the key to winning over others; involve others in small tests of change to slowly help redefine roles and relationships. |
Return to top of page
|
|
|
| Q: |
 |
How can we overcome physician resistance to change? |
A:
|
 |
Identify one physician champion and work with that person. Use his or her involvement and improvement results to convince others. Identify a nurse champion and include nurses who work with the physicians in your projects. The nurses can then work to help you influence those resistant physicians. Building nurses into the process can help with involving physicians. |
Return to top of page
|
|
|
| Q: |
 |
Some of our team members have concerns about the legal aspects of the changes we have planned. How do we address this concern? |
A:
|
 |
Perform small tests of change based on good knowledge and experience. If it does not look or feel right, do not proceed with the test. Allow the implementer(s) of the actual change to stop the test if they deem it unwise to proceed (e.g., nursing or respiratory therapy personnel should feel free to not institute a protocol with which they feel uncomfortable). These situations should be viewed as additional learning opportunities. |
Return to top of page
|
|
|
| Q: |
 |
How can we demonstrate the potential cost savings for the new system? |
A:
|
 |
Costs add up. Calculate the potential cost savings throughout the organization over the course of a year. |
Return to top of page
|
|
|
| Q: |
 |
How do we make changes without the explicit approval from our managers or senior leader for dedicated resources (time and/or people)? |
A:
|
 |
Propose that the team be a "skunkworks" to test the proposed improvements, and identify specific resources needed. |
Return to top of page
|
|
|
| Q: |
 |
How can we make our project more visible in our organization? |
A:
|
 |
Write articles for the organization newsletter. Use storyboards or posters to display progress. |
Return to top of page
|
|
|
| Q: |
 |
How can we ensure that major organizational changes such as mergers, downsizing, or reorganization will not derail our project? |
A:
|
 |
Align the project with organizational goals. Stress staff involvement in changes, in contrast to top-down decisions. Focus on patient care as the ultimate goal. Emphasize connections among cost, productivity, patient care, and patient and staff satisfaction. |
Return to top of page
|
|
|
| Q: |
 |
How do we respond to those who say that what we are planning "won't work here?" |
A:
|
 |
Build tension for change. Start small. Create opportunities for participation in change. Ask resisters to suggest alternatives. Identify and publicize prior successful changes. Build momentum ("the theory of small wins"). Communicate intentions and progress. |
Return to top of page
|
|
|
| Q: |
 |
Can we use the Model for Improvement if our organization already has a change model? |
A:
|
 |
The Model for Improvement is not meant to replace change models that organizations may be using, but rather to accelerate improvement. The model creates tension to test ideas on a small scale, rather than waiting until a solution is fully developed before action is taken. |
Return to top of page
|
|
|
| Q: |
 |
How can we gain the support of our senior leaders? |
A:
|
 |
Align incentives: use data to show potential benefits of your work. Be realistic: offer senior leaders suggestions about highly leveraged uses of short amounts of their time. Focus on the concerns of the senior leader and help the leader understand how the project fits into institutional aims and vision. Request a brief team presentation to be put on the agenda for the senior leadership group or the quality council. Identify an advocate who has the ear of the senior leader. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if our senior leader is supportive, but there is little contact between him or her and our team? |
A:
|
 |
Identify specific things you need from the senior leader and let the leader know what they are. Invite the senior leader to a team meeting. Keep the senior leader informed of your work; use e-mail, newsletter, briefings, etc. |
Return to top of page
|
|
|
| Q: |
 |
How do we spread what we are learning in one site to others in our organization? |
A:
|
 |
The most important first step to spreading improvement is to have a model of the new process or system so that everyone can see how it works and how it's better than the old way. The team can help with spread by getting great results and by making their work visible and understandable to others. It is the responsibility of the senior leadership in the organization to develop a plan for involving other sites in the organization in adapting the new process or system. |
Return to top of page
|
|
|
Senior Leadership Support
| Q: |
 |
How can senior leaders support improvement efforts? |
A:
|
 |
Establish "stretch aims" or "stretch goals." Show by your constancy and your commitment that you intend to do what is necessary in the organization to achieve the new level of performance. State and restate the aims. Monitor the process frequently. If you really want improvement to move fast, review progress daily, or hourly if necessary. Stay in touch with the improvement effort. Support the team leader. Phone the leader. Pay specific, personal attention. Visit the team. Drop in on meetings, even if only for a couple of minutes. Visit the site of the change. Walk through the Intensive Care Unit, or the clinic, or the Operating Room. Show that you're aware of the improvement work being done. Look at the charts that are monitoring progress. Ask how you as an executive can be more helpful. Move the improvement effort up on the agenda. Make it clear that improvement has high priority in the organization. One senior leader who had been formally reviewing the progress of an improvement effort as #9 or #10 on the agenda moved it to #2. That simple act was a key factor in giving the project momentum. Make sure that the team has the resources it needs. For example, the team may need designated staff time or access to key data that others have collected. Celebrate successes. Public celebration of improvement efforts or personal expressions of appreciation are just as important as any modification of pay structure. Keep the bigger system in view. The many local improvements are connected in a larger way to the system as a whole; it is the job of senior leaders to keep sight of, and help others to see, this larger context. |
Return to top of page
|
|
|
| Q: |
 |
What should be included in a good aim statement? |
A:
|
 |
Your aim statement should include what you are trying to accomplish, for whom (patient population or location), the magnitude of change, and the timeframe. Example: Reduce Adverse Drugs Events to less than .10 per ICU day for medical intensive care patients by March. |
Return to top of page
|
|
|
| Q: |
 |
How can we set a stretch aim and strive to achieve it? |
A:
|
 |
Enlist the senior leader’s help. The leader has the authority to take the status quo off the table and encourage the staff to move beyond "safe" goals. |
Return to top of page
|
|
|
| Q: |
 |
Our team could not agree on one aim, so we included several aims in our statement. Is this okay? |
A:
|
 |
As long as the aims are not conflicting, agree that the team will have a dual focus; then work toward unifying the aims as the project develops. If the aims conflict, ask your senior leader for help. |
Return to top of page
|
|
|
| Q: |
 |
Is it all right if we lower our original numerical goals once we have begun working on improvement? |
A:
|
 |
Resist the temptation to weaken goals. Identify barriers to progress and seek solutions instead of changing the goal. |
Return to top of page
|
|
|
| Q: |
 |
We have a focused aim, but our senior leader is concerned that it only addresses changes in one department. Should our aim be broader? |
A:
|
 |
Starting with parts of a system is okay, but be ready to expand the scope of the project once initial aims are achieved. |
Return to top of page
|
|
|
| Q: |
 |
What should we do if our aim becomes unclear after we have been working on improvement for several months? |
A:
|
 |
Constantly focus on aims by repeating or reviewing aims at the beginning of each meeting. |
Return to top of page
|
|
|
| Q: |
 |
No one on our team seems clear on what we are really trying to accomplish even though we have an aim statement. What do we do? |
A:
|
 |
Set numerical targets, and outline an approach and timeline for achieving them. If you can’t see clearly how to plan changes or how to measure progress towards the aim, try redrafting it to make it more actionable or seek guidance from your senior leader. |
Return to top of page
|
|