Showing posts with label Improve. Show all posts
Showing posts with label Improve. Show all posts

Tuesday, 2 August 2011

Improve Technology ROI: Focus on People


Buzzwords are great. They give us an excuse to nod our heads, act like we are paying attention, and then completely ignore issues without giving them a second thought. As long as we use buzzwords we appear (if only to ourselves) to know what's going on and we are on top of the challenge at hand. Perhaps the greatest part of working in technology is that we are never at a loss for buzzwords, or for meetings in which to use them.

Three of the greatest buzzwords in the tech arena are "People, Process, and Technology". Throw in a few other favorites, such as "alignment," "change," "culture," and... well, you get the idea. While these words are more ubiquitous in a technology discussion than fish are in the sea, they are often overlooked, misunderstood, and generally ignored. This is dangerous.

Looking over the landscape of a typical IT implementation we notice that the majority of activities are focused on process and technology. We spend tremendous amounts of time and effort defining business processes and specifying functional system requirements. We focus a large amount of time building and testing the technology. Consequently most of the people involved in IT projects are specialists in strategy, process, and technology.

So what is missing? Look closely. Did you notice the vast majority of our activities, and the majority of our team's skills, are focused on aligning process and technology? What happened to our first buzzword, "People"? Do we just nod our heads and forget to consider our people - how we can move them (that is, align them) with the process and technology? What does it mean to align people with process and technology?

Aligning People

For some, aligning people means providing training so employees know how to use the system. Others say you need to include communications to align their people. Some advanced organizations even extend their efforts to include mapping out changes to job descriptions and responsibilities.

While these are all important activities to help achieve alignment of people, process and technology, they don't actually help us understand what alignment is. And if you don't know what it is, how do you know when you have achieved it?

Alignment only occurs when your people, process and technology all perform together in a symbiotic relationship that delivers the desired results. The people use the technology. The people follow the process. They key here is that the people must actually use the technology and the people must actually follow the process. This requires people, ALL of the people, change their behavior to achieve the desired results.

Focus on Behavior Change to Improve ROI

"Did he just say our technology project needs to focus on changing people's behavior? I thought we were implementing technology, not disciplining children or providing group therapy. What is all this behavior talk anyway?"

Consider the relationship between user behavior and return on investment (ROI). When do we actually realize ROI from our technology projects? Is it when the technology is delivered? Sadly, no. We only realize our ROI when the people actually use the technology. If a system is delivered, but not used, it does not return any value to the organization. So, while successfully deploying the technology is on the critical path (pardon the gratuitous use of the buzzword) to achieving ROI, the critical path is only completed when the system is used effectively by our people.

Sounds pretty straightforward, right? Wrong. This simple idea has tremendous implications that require advanced thought. It means we need to rethink how we structure technology projects, who we involve in the process, and how we define success. Looking back over the landscape of a typical IT implementation we notice activities focusing on behavior change are conspicuously missing. Worse still, people with skills and expertise in behavior change are typically not even part of the implementation team. This is the problem.

Example: User Behaviors' Impact on ROI and on the Customer Experience

I worked with a client who did very little to drive desired behavior when implementing a new CRM system. As expected, they had numerous behavior problems that reduced their ROI and degraded the customer experience. Sales reps did not see "what's in it for me", so they would often not use the system at all or they would only enter partial, inaccurate customer data. Customer service reps would not reliably create problem tickets, nor would they regularly update their progress on resolving customer issues. Managers would not use the system to track progress or to analyze department performance.

The impact to the organization and to the customers experience was severe. The organization wasted vast amounts of time and effort performing unnecessary tasks, such as tracking down information that was not entered by one individual but was required by others to perform their jobs. The lack of complete and accurate data made it impossible for management to utilize the system reports to make reliable, informed decisions. Executives and sales reps were unable to review vital customer activity data to prepare for additional sales meetings. The customers experience was degraded by delays resulting from having to repeat conversations that were not properly logged in the system.

It was only after the client had experienced these problems for quite some time that management decided to address user behavior. After users changed and demonstrated desired behavior, the system delivered significant value and the customer experienced improved. Had management proactively focused on driving desired behavior earlier they would have avoided the period of poor performance and significantly increased their overall ROI from the start.

Defining Project "Success"

How is "success" typically defined for a technology project? Projects are often judged successful if they are delivered on time and on budget. While delivering on time and on budget are indeed causes for celebration, do they fully define success? How often do we actually go back and measure our results, our realized ROI, against the forecasted return defined in the business case that justified the project? If we deliver on time but never achieve the forecasted ROI are we really successful?

This reveals several important questions. Who actually owns ROI? Who is responsible for ensuring we actually change user behavior and realize our anticipated ROI? What are the consequences for not achieving forecasted ROI? We need to stop defining success at the midpoint of the critical path (delivering technology) and shift our focus to the end of the critical path, achieving effective system use that delivers ROI.

How do we Change User Behavior?

So, how do we do we change user behavior?

First, we realize people are unpredictable. Unlike process flows or lines of code (which are linear, logical and controllable), people are wildcards. They do not always act rationally or predictably. They can be influenced and encouraged, but they cannot be controlled. Is it any wonder that even though we define a very clear logical process and system that it is not always used as intended? So, how do we compensate for the unpredictable and uncontrollable? Who can help us do this?

To address these challenges, we need to learn more about people and how to influence their behavior. Expanding our knowledge of individuals to include an understanding of personality types, communication processes, conflict styles, individual motivation and learning styles gives us many tools for improving our ability to change behavior.

Of course, we do not work in isolation. We work in small and large groups, which have their own unique characteristics and processes. People behave differently in groups than they do alone. We need to understand more about interpersonal relationships, group dynamics, and creating and managing high performing groups. We need to understand how trust, honesty and ethics impact group behavior and how we can use this knowledge to create an environment that drives desired behavior.

Moreover, individuals and groups do not operate in a vacuum; they operate in the context of a larger organizational system. We need to understand the impact organizational forces have on individual and group behavior, and then align these forces to drive desired behavior. Can we realistically expect people to behave in one way (like, use our system as designed) if there are major organizational forces that drive them to behave in another way?

Who Can Help?

This may all sound exhausting and impossible but there are people who can help: Human Resource (HR) and Organization Development (OD) professionals.

These two groups have complimentary skill sets that are perfect for helping us align organizational forces and drive desired user behavior. HR professionals have the skills necessary to put together appropriate performance evaluation, feedback and development plans. OD professionals are trained in conducting holistic organizational analysis and in designing appropriate interventions to facilitate the desired change.

Do we really need OD and HR people? Can't we use our current project team? No! IT people do not have the required skills - their expertise lies in technology. Strategy people typically are not qualified either. The knowledge and skills they possess to develop business cases, process flows, and ROI forecasts are very different from that required to change user behavior.

To align "people" with process and technology we actually need to rely on professionals with expertise in "people" issues - HR and OD experts. But how do they fit within the development lifecycle and when do we include them in the development process?

A Better Approach to IT Projects

We often assume that if we teach people what to do then they will act as instructed. But, what if the problem is not just that they don't know how to use the system? What if they can't or won't use the system for other reasons?

Imagine you are sick and you go to the doctor. He doesn't just say hello, shake your hand and then give you an operation. Instead the doctor asks you some questions, runs some test, gets x-rays and inspects your body. Only after he has gathered data and made an informed diagnosis does he develop treatment plans. A (somewhat) similar approach is appropriate for IT implementations.

Current efforts to promote user adoption that only include delivering training and communication are akin to the doctor skipping the data gathering and just reaching for the scalpel when you walk in the door. Wouldn't it be better if we gather some data, diagnose what drives user behavior in our organization and then put together an appropriate treatment plan? That is exactly what we should do.

We begin by gathering data from multiple sources, at multiple levels in the organization, in order to triangulate and identify the major forces driving user behavior. Once this is done and our diagnosis complete, we put together a treatment plan, that is, determine appropriate actions (called OD "interventions") to promote user adoption. Interventions may be conducted at multiple points in time: project start-up, during development, at go-live and at multiple intervals following system deployment.

Example: Structuring a Project to Drive User Behavior

So, how will this work? At the start of the project an OD consultant leads the project team (IT and business SMEs) in group development work and helps them mature into a highly productive work team. The consultant also helps IT and business agree on a definition of project success and a plan for sharing responsibility for measuring and achieving ROI at various points after go-live.

The consultant then gathers data to identify the organizational factors that drive user adoption. He conducts interviews across all levels of the organization, conducts focus groups with representatives from several user departments, surveys employees, and reviews various documents such as strategic plans and job descriptions. The consultant then facilitates leaders and business representatives in reviewing the data, diagnosing the situation, and developing an intervention strategy. Finally, interventions are held prior to go live (to prepare users for the change), during the first few weeks of the deployment (to assist users during the change) and at multiple scheduled review points (to help users continue to grow by identifying lessons learned and by sharing best practices across the organization).

Including HR and OD professionals in IT projects is critical for aligning people, process and technology. Conducting an organizational analysis, and more importantly, involving people in the process, helps drive desired behavior. It allows us to make sure we are investing our efforts in conducting appropriate interventions and in addressing the "right" issues. The time and effort required to drive desired user behavior delivers significant value through improved system use, faster realization of ROI and an improved customer experience.

Final Thoughts

The next time you are planning an IT project, ask yourself if you are doing enough to address the "people" issues. Are you focusing on promoting user adoption and achieving ROI or are you just focusing on delivering the technology? How much would you increase ROI if you improved user adoption of the system? Do you have skilled HR and OD people helping you drive success? Do you have the right skills and understanding of individual behavior and group development processes to effectively address the "people" issues?

Is there anything you COULD and SHOULD be doing to align people, process and technology?




Jason C. Whitehead is founder and President of TriTuns Innovation, LLC. He has over ten years experience implementing effective technology solutions and helping organizations address the critical organizational issues that drive effective system use. He holds a Master of Science in Analysis Design & Management of Information Systems from the London School of Economics, a Master of Science in Organization Development & Strategic Human Resources from Johns Hopkins University and a Bachelor of Business Administration in Finance from George Washington University. He can be reached at jwhitehead@tritunsinnovation.com.





This post was made using the Auto Blogging Software from WebMagnates.org This line will not appear when posts are made after activating the software to full version.

Friday, 1 July 2011

Facebook Disables Numerous Apps That Have Negative User Feedback, May Need to Improve Enforcement Communications

On Friday, Facebook increased user feedback’s weight in its automated Platform enforcement system. This caused it to automatically disable a number of app that had received a large volume of negative feedback. Now, some developers are upset that they weren’t given fair warning to correct their apps, and several claim they haven’t done anything wrong — and a few who were taken off have been reinstated already.


So far, Facebook has provided an appeal process for developers of apps that have been disabled and has said that improved feedback monitoring in app Insights will launch soon. Still, the site’s effort to protect the user experience from spam apps has hurt its relationship with some in the developer community.



Reports in the Facebook Developer forums indicate the disabled were mostly small to mid-sized, with some in the 10,000 to 20,000 daily active user range including one called Game of Truth, which you can see above has dropped to zero DAU. Many of the affected developers are threatening to leave the Facebook Platform, while other are calling for better benchmarks for assessing how much negative feedback is too much.


The company’s goal is to keep the user experience enjoyable for both applications users and non-users so developers have  healthy Platform to work on long into the future. Facebook CTO Bret Taylor said that by improving its automatic enforcement systems, the site reduced spam by 95% in 2010 while also reducing enforcement actions.


In a statement, Facebook said “we started getting a lot of user feedback, spiking significantly over the past week, on the amount of application spam people are seeing in their feeds and on their walls. As a result, we turned on a new enforcement system [Friday] that took user feedback much more heavily into account. This resulted in a number of applications with high negative user feedback being disabled or having certain features disabled.”


This means that the apps which were disabled didn’t necessarily violate Platform policy, but somehow led users to mark their posts as spam or report them. The apps may not have made it clear to a user when they would post to their wall or send invites to friends. It’s also possible that users who received wall posts from apps their friends were using marked those posts as spam because they had never personally used the app.



Enforcement Warning Systems and Negative Feedback Benchmarks


Some developers in the forum and who have emailed us directly claim they’ve lost development and marketing investments as well as the trust of their core user because their apps were removed from the Platform. They believe they were treated unfairly because they weren’t given advance notice or the opportunity to fix their apps.


Facebook may need to reconsider the warning and communication protocols for its enforcement system. Leaving apps with negative feedback running for a few more days after warning developers may in fact be better for the Platform experience, as users may grow skeptical of spending time and money on games if they fear they may be suddenly disabled.


Other developers are seeking a better way to gauge what level of negative feedback Facebook deems unacceptable. A Hong Kong developer posting on the forum under the alias ‘takwing’ explained [edited for clarity]:


“For example, I include a wall post feature, and it turns out that 99% of the users love it and 1% always mark the wall post as spam. Does this 99% good out-weigh the 1% bad? How about the case of 90% good vs 10% bad?  We need a certain guideline so that we can review and make judgement on whehter we should implement a feature or not. As I may think that the feature is good and most people love it… but it turns out Facebook thinks 10% bad feedback is unacceptable and bans my app.”


Facebook should consider releasing some sort benchmark for an acceptable level of negative feedback. This would allow developers to test new features, but know to remove them if negative feedback exceeds the benchmark.


A Facebook engineer named Eugene responded to the developers in the forums stating “Where we have failed is not providing enough feedback about negative engagement metrics to developers before needing to take this action. This is something we are working hard to fix with the new Application Insights that will be launching over the next few weeks – you will have detailed information about both positive and negative engagement of the content your application generates.”


The planned improvements, which include the ability to see how quantities of posts marked as spam and stream story hides, should make it easier to monitor feedback fluctuations. Developers will need to either need to confer to establish benchmarks or Facebook will need to provide one to make this Insights data as useful as possible.


Some developers have posted to the forum saying their apps have been re-enabled, and others have been allowed to recreate their apps with a new app IDs and have users re-grant permissions. Several others, though, report they’ve received automatic denials when they tried to appeal their decision.


Even if Facebook is trying help users and preserve trust in the Platform so it can continue to make money for developers, the site will need to learn from this incident. It should consider being more cautious when changing its automatic enforcement systems, and look at how it can improve data and communication regarding Platform enforcement.


Just a month ago, Facebook angered some in the developer community when several developers received notice that they had 48 hours to change fix authentication data leaks, even though they weren’t leaking data. Communication needs to improve if Facebook wants to entice developers to build on its Platform.



Generated by BlogIt

BlogIt - Auto Blogging Software for YOU!

BlogIt - autoblogging software for YOU

BlogIt - autoblogging software for YOU