<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>fail Archives - Artificial Intelligence</title>
	<atom:link href="https://www.aiuniverse.xyz/tag/fail/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.aiuniverse.xyz/tag/fail/</link>
	<description>Exploring the universe of Intelligence</description>
	<lastBuildDate>Fri, 25 Jun 2021 10:29:01 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	
	<item>
		<title>Why Machine Learning Projects Fail – and How to Make Sure They Don’t</title>
		<link>https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/</link>
					<comments>https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/#respond</comments>
		
		<dc:creator><![CDATA[aiuniverse]]></dc:creator>
		<pubDate>Fri, 25 Jun 2021 10:29:00 +0000</pubDate>
				<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[projects]]></category>
		<category><![CDATA[Why]]></category>
		<guid isPermaLink="false">https://www.aiuniverse.xyz/?p=14551</guid>

					<description><![CDATA[<p><img width="300" height="197" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3-300x197.png" class="attachment-medium size-medium wp-post-image" alt="Why Machine Learning Projects Fail – and How to Make Sure They Don’t" decoding="async" fetchpriority="high" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3-300x197.png 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3.png 333w" sizes="(max-width: 300px) 100vw, 300px" /></p>
<p>Source &#8211; https://www.eweek.com/ he hype about machine learning (ML) is warranted. Machine learning is not just making things easier for the companies that are taking advantage of it. It’s also changing the way they do business. For example, machine learning is: Being used by financial institutions to quickly detect fraudulent activity Enabling healthcare practitioners to <a class="read-more-link" href="https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/">Read More</a></p>
<p>The post <a href="https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/">Why Machine Learning Projects Fail – and How to Make Sure They Don’t</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></description>
										<content:encoded><![CDATA[<p><img width="300" height="197" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3-300x197.png" class="attachment-medium size-medium wp-post-image" alt="Why Machine Learning Projects Fail – and How to Make Sure They Don’t" decoding="async" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3-300x197.png 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/06/Capture-3.png 333w" sizes="(max-width: 300px) 100vw, 300px" /></p>
<p class="wp-block-paragraph">Source &#8211; https://www.eweek.com/</p>



<p class="wp-block-paragraph">he hype about machine learning (ML) is warranted. Machine learning is not just making things easier for the companies that are taking advantage of it. It’s also changing the way they do business. For example, machine learning is:</p>



<ul class="wp-block-list"><li>Being used by financial institutions to quickly detect fraudulent activity</li><li>Enabling healthcare practitioners to diagnose diseases and prescribe treatments more effectively</li><li>Helping manufacturers monitor equipment so issues can be dealt with before they disrupt operations</li><li>Allowing streaming services to identify customers at risk of taking their business elsewhere and helping determine what steps can be taken to retain them</li></ul>



<p class="wp-block-paragraph">With increasing data volumes, low-cost data storage, and less expensive, more powerful data processing, the potential applications of machine learning will grow exponentially.</p>



<p class="wp-block-paragraph">So why are so many companies hesitant to jump on the machine learning bandwagon – and why is the success rate so low for those that do embark on these projects? Afterall, organizations such as Gartner note that up to 85% of machine learning projects ultimately fail to deliver on their intended promises to business.</p>



<p class="wp-block-paragraph">More importantly, what can companies do to ensure a higher success rate so they can leverage the promise of machine learning?</p>



<h2 class="wp-block-heading"><strong>Machine Learning is Different</strong></h2>



<p class="wp-block-paragraph">To increase the chances of machine learning project success, the first step is to understand that these projects are not the same as typical application and software development projects. There are different processes, terminology, workflows, and tools involved.</p>



<p class="wp-block-paragraph">There are also different staffing requirements. Among the most important are data scientists, who are especially critical when it comes to defining the success criteria, final deployment, and continuous monitoring of the machine learning model.</p>



<p class="wp-block-paragraph">Data engineers, business intelligence specialists, DevOps, and application developers also play key roles. Few organizations have the internal resources to fill all these positions. Their options: hire them, which isn’t always easy given that machine learning is still a relatively new field with few experienced professionals, or outsource.</p>



<p class="wp-block-paragraph">Even if an organization does have the staffing covered, it can be difficult to facilitate collaboration and communication between different teams. Traditional software and application development usually differs greatly from data science projects. Whereas software development tends to be more predictable and measurable, data science can entail multiple iterations and experimentation. Expectations are different. Deliverables are different.</p>



<h2 class="wp-block-heading"><strong>The Issue of Data Quantity and Quality</strong></h2>



<p class="wp-block-paragraph">According to a number of research initiatives (e.g., Hidden Debt in Machine Learning Systems) technical debt resides in areas common to many machine learning projects: Data Quality, Model Quality, Feature Versioning, Model Monitoring, Data Labeling, Model Explainability, and Fairness, Process Automation, Human Intervention (Review) in-place capabilities.</p>



<p class="wp-block-paragraph">There’s also the matter of data quantity and quality. Machine learning projects use large datasets, since larger datasets facilitate better predictions. But as the size of the data increases, so do the challenges.</p>



<p class="wp-block-paragraph">Data is usually merged from multiple sources. Often that data is not in sync, which can create confusion. In addition, data can get merged that wasn’t meant to be merged, resulting in data points with the same name but different meanings. Bad data can generate results that aren’t actionable or insightful, or that are misleading.</p>



<p class="wp-block-paragraph">The lack of labeled data can also be an issue. Some teams may try to take on the laborious task of labeling and annotating training data themselves. Some may even try to create their own labeling and annotation automation technology. The problem is that a great deal of time and expertise is committed to the labeling process rather than machine learning model training.</p>



<p class="wp-block-paragraph">Outsourcing can save both time and money but doesn’t work well if the labeling task requires specific domain knowledge. In those cases, organizations also must invest in formal and standardized training of annotators to ensure quality and consistency across datasets. The other option is to develop their own data labeling tool if the data to be labeled is extremely complex. However, this can require more engineering overhead than the machine learning task itself.</p>



<p class="wp-block-paragraph">Yet another data-related issue is that the data required in a machine learning project often resides in different places with different security constraints and in different formats — structured, unstructured, video files, audio files, text, and images. Data preparation is required, a process that includes searching, cleaning, transforming, organizing, and collecting data. It’s a tedious activity that can require teams to spend up to 80% of their time converting raw data into high-quality, analysis-ready output.</p>



<p class="wp-block-paragraph">For both the data labeling and data preparation, automation can help remedy the situation – but again, requires expertise that internal teams often lack.</p>



<h2 class="wp-block-heading"><strong>Great Expectations</strong></h2>



<p class="wp-block-paragraph">Machine learning projects aren’t cheap, so it’s not uncommon for organizations to have overly ambitious goals for them. There are often expectations that a project will completely transform the company or a product and generate an enormous return on investment. That creates a lot of pressure that can, in turn, lead to second-guessing on strategies and tactics.</p>



<p class="wp-block-paragraph">Not surprisingly, these kinds of projects tend to drag out. As a result, both the project teams and management lose confidence and interest in the project, and budgets max out. Even the most expertly run projects are doomed to fail if the goals are unrealistic.</p>



<p class="wp-block-paragraph">In other cases, machine learning projects kick-off without alignment on expectations, goals, and success criteria between the business and project teams. Without clearly defined success indicators, it’s difficult to determine whether a project is successful, what changes need to be made, if the model is effectively solving the intended business needs, or if other options should be considered.</p>



<h2 class="wp-block-heading"><strong>Machine Learning Success Factors</strong></h2>



<p class="wp-block-paragraph">While there are no specific guidelines for ensuring a successful machine learning project, there are ways to overcome many of the issues that can lead to project failure. Among them:</p>



<ul class="wp-block-list"><li>An understanding of how machine learning works, how it differs from other project types, and what’s required to execute a project</li><li>A properly scoped project with realistic goals, budget, and leadership support</li><li>The resources to run a machine learning project, including experienced team members — whether in-house or outsourced — and a commitment to collaboration and open communication</li><li>Large amounts of data, preferably labeled</li><li>Capabilities for collecting, storing, labeling, cleaning, quickly accessing, and processing large volumes of data</li><li>Advanced tools for machine learning models and data monitoring</li><li>Capabilities for a human to review the machine learning system and inference at any place and point in time</li><li>Software tools for executing machine learning algorithms</li><li>A development platform, such as AWS, Baidu, Google, IBM, or Microsoft</li></ul>



<p class="wp-block-paragraph">Follow these tips and your machine learning project won’t derail before your organization can enjoy the many benefits that this modern technology provides.</p>
<p>The post <a href="https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/">Why Machine Learning Projects Fail – and How to Make Sure They Don’t</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.aiuniverse.xyz/why-machine-learning-projects-fail-and-how-to-make-sure-they-dont/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>Why So Many Data Science Projects Fail to Deliver</title>
		<link>https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/</link>
					<comments>https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/#respond</comments>
		
		<dc:creator><![CDATA[aiuniverse]]></dc:creator>
		<pubDate>Wed, 03 Mar 2021 09:33:35 +0000</pubDate>
				<category><![CDATA[Data Science]]></category>
		<category><![CDATA[data science]]></category>
		<category><![CDATA[deliver]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[projects]]></category>
		<category><![CDATA[Why]]></category>
		<guid isPermaLink="false">http://www.aiuniverse.xyz/?p=13211</guid>

					<description><![CDATA[<p><img width="300" height="200" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-300x200.jpg" class="attachment-medium size-medium wp-post-image" alt="Why So Many Data Science Projects Fail to Deliver" decoding="async" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-300x200.jpg 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-1024x683.jpg 1024w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-768x512.jpg 768w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1.jpg 1290w" sizes="(max-width: 300px) 100vw, 300px" /></p>
<p>Source &#8211; https://sloanreview.mit.edu/ Organizations can gain more business value from advanced analytics by recognizing and overcoming five common obstacles. More and more companies are embracing data science as a function and a capability. But many of them have not been able to consistently derive business value from their investments in big data, artificial intelligence, and <a class="read-more-link" href="https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/">Read More</a></p>
<p>The post <a href="https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/">Why So Many Data Science Projects Fail to Deliver</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></description>
										<content:encoded><![CDATA[<p><img width="300" height="200" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-300x200.jpg" class="attachment-medium size-medium wp-post-image" alt="Why So Many Data Science Projects Fail to Deliver" decoding="async" loading="lazy" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-300x200.jpg 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-1024x683.jpg 1024w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1-768x512.jpg 768w, https://www.aiuniverse.xyz/wp-content/uploads/2021/03/MAG-Joshi-1290x860-1.jpg 1290w" sizes="auto, (max-width: 300px) 100vw, 300px" /></p>
<p class="wp-block-paragraph">Source &#8211; https://sloanreview.mit.edu/</p>



<p class="wp-block-paragraph">Organizations can gain more business value from advanced analytics by recognizing and overcoming five common obstacles.</p>



<p class="wp-block-paragraph">More and more companies are embracing data science as a function and a capability. But many of them have not been able to consistently derive business value from their investments in big data, artificial intelligence, and machine learning.1 Moreover, evidence suggests that the gap is widening between organizations successfully gaining value from data science and those struggling to do so.2</p>



<p class="wp-block-paragraph">To better understand the mistakes that companies make when implementing profitable data science projects, and discover how to avoid them, we conducted in-depth studies of the data science activities in three of India’s top 10 private-sector banks with well-established analytics departments. We identified five common mistakes, as exemplified by the following cases we encountered, and below we suggest corresponding solutions to address them.</p>



<h3 class="wp-block-heading">Mistake 1: The Hammer in Search of a Nail</h3>



<p class="wp-block-paragraph">Hiren, a recently hired data scientist in one of the banks we studied, is the kind of analytics wizard that organizations covet.<a href="https://sloanreview.mit.edu/article/why-so-many-data-science-projects-fail-to-deliver/?og=Home+Editors+Picks#ref3">3</a>&nbsp;He is especially taken with the&nbsp;<em>k-nearest neighbors</em>&nbsp;algorithm, which is useful for identifying and classifying clusters of data. “I have applied k-nearest neighbors to several simulated data sets during my studies,” he told us, “and I can’t wait to apply it to the real data soon.”</p>



<p class="wp-block-paragraph">Hiren did exactly that a few months later, when he used the k-nearest neighbors algorithm to identify especially profitable industry segments within the bank’s portfolio of business checking accounts. His recommendation to the business checking accounts team: Target two of the portfolio’s 33 industry segments.</p>



<p class="wp-block-paragraph">This conclusion underwhelmed the business team members. They already knew about these segments and were able to ascertain segment profitability with simple back-of-the-envelope calculations. Using the k-nearest neighbors algorithm for this task was like using a guided missile when a pellet gun would have sufficed.</p>



<p class="wp-block-paragraph">In this case and some others we examined in all three banks, the failure to achieve business value resulted from an infatuation with data science solutions. This failure can play out in several ways. In Hiren’s case, the problem did not require such an elaborate solution. In other situations, we saw the successful use of a data science solution in one arena become the justification for its use in another arena in which it wasn’t as appropriate or effective. In short, this mistake does not arise from the technical execution of the analytical technique; it arises from its misapplication.</p>



<p class="wp-block-paragraph">After Hiren developed a deeper understanding of the business, he returned to the team with a new recommendation: Again, he proposed using the k-nearest neighbors algorithm, but this time at the customer level instead of the industry level. This proved to be a much better fit, and it resulted in new insights that allowed the team to target as-yet untapped customer segments. The same algorithm in a more appropriate context offered a much greater potential for realizing business value.</p>



<p class="wp-block-paragraph">It’s not exactly rocket science to observe that analytical solutions are likely to work best when they are developed and applied in a way that is sensitive to the business context. But we found that data science does seem like rocket science to many managers. Dazzled by the high-tech aura of analytics, they can lose sight of context. This was more likely, we discovered, when managers saw a solution work well elsewhere, or when the solution was accompanied by an intriguing label, such as “AI” or “machine learning.” Data scientists, who were typically focused on the analytical methods, often could not or, at any rate, did not provide a more holistic perspective.</p>



<p class="wp-block-paragraph">To combat this problem, senior managers at the banks in our study often turned to training. At one bank, data science recruits were required to take product training courses taught by domain experts alongside product relationship manager trainees. This bank also offered data science training tailored for business managers at all levels and taught by the head of the data science unit. The curriculum included basic analytics concepts, with an emphasis on questions to ask about specific solution techniques and where the techniques should or should not be used. In general, the training interventions designed to address this problem aimed to facilitate the cross-fertilization of knowledge among data scientists, business managers, and domain experts and help them develop a better understanding of one another’s jobs.</p>



<p class="wp-block-paragraph">In related fieldwork, we have also seen process-based fixes for avoiding the mistake of jumping too quickly to a favored solution. One large U.S.-based aerospace company uses an approach it calls the Seven Ways, which requires that teams identify and compare at least seven possible solution approaches and then explicitly justify their final selection.</p>



<h3 class="wp-block-heading">Mistake 2: Unrecognized Sources of Bias</h3>



<p class="wp-block-paragraph">Pranav, a data scientist with expertise in statistical modeling, was developing an algorithm aimed at producing a recommendation for the underwriters responsible for approving secured loans to small and medium-sized enterprises. Using the credit approval memos (CAMs) for all loan applications processed over the previous 10 years, he compared the borrowers’ financial health at the time of their application with their current financial status. Within a couple of months, Pranav had a software tool built around a highly accurate model, which the underwriting team implemented.</p>



<p class="wp-block-paragraph">Unfortunately, after six months, it became clear that the delinquency rates on the loans were higher after the tool was implemented than before. Perplexed, senior managers assigned an experienced underwriter to work with Pranav to figure out what had gone wrong.</p>



<p class="wp-block-paragraph">The epiphany came when the underwriter discovered that the input data came from CAMs. What the underwriter knew, but Pranav hadn’t, was that CAMs were prepared only for loans that had already been prescreened by experienced relationship managers and were very likely to be approved. Data from loan applications rejected at the prescreening stage was not used in the development of the model, which produced a huge selection bias. This bias led Pranav to miss the import of a critical decision parameter: bounced checks. Unsurprisingly, there were very few instances of bounced checks among the borrowers whom relationship managers had prescreened.</p>



<p class="wp-block-paragraph">The technical fix in this case was easy: Pranav added data on loan applications rejected in prescreening, and the “bounced checks” parameter became an important element in his model. The tool began to work as intended.</p>



<p class="wp-block-paragraph">The bigger problem for companies seeking to achieve business value from data science is how to discern such sources of bias upfront and ensure that they do not creep into models in the first place. This is challenging because laypeople — and sometimes analytics experts themselves — can’t easily tell how the “black box” of analytics generates output. And analytics experts who do understand the black box often do not recognize the biases embedded in the raw data they use.</p>



<p class="wp-block-paragraph">The banks in our study avoid unrecognized bias by requiring that data scientists become more familiar with the sources of the data they use in their models. For instance, we saw one data scientist spend a month in a branch shadowing a relationship manager to identify the data needed to ensure that a model produced accurate results.</p>



<p class="wp-block-paragraph">We also saw a project team composed of data scientists and business professionals use a formal bias-avoidance process, in which they identified potential predictor variables and their data sources and then scrutinized each for potential biases. The objective of this process was to question assumptions and otherwise “deodorize” the data — thus avoiding problems that can arise from the circumstances in which the data was created or gathered.4</p>



<h3 class="wp-block-heading">Mistake 3: Right Solution, Wrong Time</h3>



<p class="wp-block-paragraph">Kartik, a data scientist with expertise in machine learning, spent a month developing a sophisticated model for analyzing savings account attrition, and he then spent three more months fine-tuning it to improve its accuracy. When he shared the final product with the savings account product team, they were impressed, but they could not sponsor its implementation because their annual budget had already been expended.</p>



<p class="wp-block-paragraph">Eager to avoid the same result the following year, Kartik presented his model to the product team before the budgeting cycle began. But now the team’s mandate from senior management had shifted from account retention to account acquisition. Again, the team was unable to sponsor a project based on Kartik’s model.</p>



<p class="wp-block-paragraph">In his third year of trying, Kartik finally got approval for the project, but he had little to celebrate. “Now they want to implement it,” he told us, with evident dismay, “but the model has decayed and I will need to build it again!”</p>



<p class="wp-block-paragraph">The mistake that blocks banks from achieving value in cases like this is a lack of synchronization between data science and the priorities and processes of the business. To avoid it, better links between data science and the strategies and systems of the business are needed.</p>



<p class="wp-block-paragraph">Senior executives can ensure the alignment of data science activities with organizational strategies and systems by more tightly integrating data science practices and data scientists with the business in physical, structural, and process terms. For example, one bank embedded data scientists in business teams on a project basis. In this way, the data scientists rubbed elbows with the business team day to day, becoming more aware of its priorities and deadlines — and in some cases actually anticipating unarticulated business needs. We have also seen data science teams colocated with business teams, as well as the use of process mandates, such as requiring that project activities be conducted at the business team’s location or that data scientists be included in business team meetings and activities.</p>



<p class="wp-block-paragraph">Generally speaking, data scientists ought to be concentrating their efforts on the problems deemed most important by business leaders.<a href="https://sloanreview.mit.edu/article/why-so-many-data-science-projects-fail-to-deliver/?og=Home+Editors+Picks#ref5">5</a> But there is a caveat: Sometimes data science produces unexpected insights that should be brought to the attention of senior leaders, regardless of whether they align with current priorities.6 So, there is a line to be walked here. If an insight arises that does not fit current priorities and systems but nonetheless could deliver significant value to the company, it is incumbent upon data scientists to communicate this to management.</p>



<p class="wp-block-paragraph">We found that to facilitate exploratory work, bank executives sometimes assigned additional data scientists to project teams. These data scientists did&nbsp;<em>not</em>&nbsp;colocate and were instructed not to concern themselves with team priorities. On the contrary, they were tasked with building alternative solutions related to the project. If these solutions turned out to be viable, the head of the data science unit pitched them to senior management. This dual approach recognizes the epistemic interdependence between the data science and business professionals — a scenario in which data science seeks to address today’s business needs as well as detect opportunities to innovate and transform current business practices.<a href="https://sloanreview.mit.edu/article/why-so-many-data-science-projects-fail-to-deliver/?og=Home+Editors+Picks#ref7">7</a>&nbsp;Both roles are important, if data science is to realize as much business value as possible.</p>



<h3 class="wp-block-heading">Mistake 4: Right Tool, Wrong User</h3>



<p class="wp-block-paragraph">Sophia, a business analyst, worked with her team to develop a recommendation engine capable of offering accurately targeted new products and services to the bank’s customers. With assistance from the marketing team, the recommender was added to the bank’s mobile wallet app, internet banking site, and emails. But the anticipated new business never materialized: Customer uptake of the product suggestions was much lower than anticipated.</p>



<p class="wp-block-paragraph">To discover why, the bank’s telemarketers surveyed a sample of customers who did not purchase the new products. The mystery was quickly solved: Many customers doubted the credibility of recommendations delivered through apps, websites, and emails.</p>



<p class="wp-block-paragraph">Still looking for answers, Sophia visited several of the bank’s branches, where she was surprised to discover the high degree of trust customers appeared to place in the advice of relationship managers (RMs). A few informal experiments convinced her that customers would be much more likely to accept the recommendation engine’s suggestions when presented in the branch by an RM. Realizing that the problem wasn’t the recommender’s model but the delivery mode of the recommendations, Sophia met with the senior leaders in branch banking and proposed relaunching the recommendation engine as a tool to support product sales through the RMs. The redesigned initiative was a huge success.</p>



<p class="wp-block-paragraph">The difficulties Sophia encountered highlight the need to pay attention to how the outputs of analytical tools are communicated and used. To generate full value for customers and the business, user experience analysis should be included in the data science design process. At the very least, user testing should be an explicit part of the data science project life cycle. Better yet, a data science practice could be positioned within a human-centered design frame. In addition to user testing, such a frame could mandate user research on the front end of the data science process.</p>



<p class="wp-block-paragraph">While we did not see instances of data science embedded within design thinking or other human-centered design practices in this study, we did find that the shadowing procedures described above sometimes operated as a kind of user experience analysis. As data scientists shadowed other employees to understand the sources of data, they also gained an understanding of users and channels through which solutions could be delivered. In short, the use of shadowing in data science projects contributes to a better understanding of the processes that generate data, and of solution users and delivery channels.</p>



<h3 class="wp-block-heading">Mistake 5: The Rocky Last Mile</h3>



<p class="wp-block-paragraph">The bank’s “win-back” initiative, which was aimed at recovering lost customers, had made no progress for months. And that day’s meeting between the data scientists and the product managers, which was supposed to get the initiative back on track, was not going well either.</p>



<p class="wp-block-paragraph">Data scientists Dhara and Viral were focused on how to identify which lost customers were most likely to return to the bank, but product managers Anish and Jalpa wanted to discuss the details of the campaign to come and were pushing the data scientists to take responsibility for its implementation immediately. After the meeting adjourned without a breakthrough, Viral vented his frustration to Dhara: “If data scientists and analysts do everything, why does the bank need product managers?&nbsp;<em>Our</em>&nbsp;job is to develop an analytical solution; it’s&nbsp;<em>their</em>&nbsp;job to execute.”</p>



<p class="wp-block-paragraph">By the next meeting, though, Viral seemed to have changed his mind. He made a determined effort to understand why the product managers kept insisting that the data scientists take responsibility for implementation. He discovered that on multiple occasions in the past, the information systems department had given the bank’s product managers lists of customers to target for win-back that had not resulted in a successful campaign. It turned out that using the lists had been extremely challenging, partly due to an inability to track customer contacts — so the product managers felt that being given another list of target customers was simply setting them up for another failure.</p>



<p class="wp-block-paragraph">With this newfound understanding of the problem from the point of view of the product managers, Viral and Dhara added to their project plan the development of a front-end software application for the bank’s telemarketers, email management teams, branch banking staff, and assets teams. This provided them with a tool where they could feed information from their interactions with customers and make better use of the lists provided by the data science team. Finally, the project moved ahead.</p>



<p class="wp-block-paragraph">Viral and Dhara’s actions required an unusual degree of empathy and initiative. They stepped out of their roles as data scientists and acted more like project leaders. But companies probably should not depend on data scientists in this way, and they may not want to — after all, the technical expertise of data scientists is a scarce and expensive resource.</p>



<p class="wp-block-paragraph">Instead, companies can involve data scientists in the implementation of solutions. One bank in our study achieved this by adding estimates of the business value delivered by data scientists’ solutions to their performance evaluations. This motivated data scientists to ensure the successful implementation of their solutions. The bank’s executives acknowledged that this sometimes caused data scientists to operate too far outside their assigned responsibilities. However, they believed that ensuring value delivery justified the diversion of data science resources, and that it could be corrected on a case-by-case basis, if the negative impact on the core responsibilities of data scientists became excessive.</p>



<p class="wp-block-paragraph">The mistakes we identified invariably occurred at the interfaces between the data science function and the business at large. This suggests that leaders should be adopting and promoting a broader conception of the role of data science within their companies — one that includes a higher degree of coordination between data scientists and employees responsible for problem diagnostics, process administration, and solution implementation. This tighter linkage can be achieved through a variety of means, including training, shadowing, colocating, and offering formal incentives. Its payoff will be fewer solution failures, shorter project cycle times, and, ultimately, the attainment of greater business value.</p>
<p>The post <a href="https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/">Why So Many Data Science Projects Fail to Deliver</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.aiuniverse.xyz/why-so-many-data-science-projects-fail-to-deliver/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>Why machine learning strategies fail</title>
		<link>https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/</link>
					<comments>https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/#respond</comments>
		
		<dc:creator><![CDATA[aiuniverse]]></dc:creator>
		<pubDate>Fri, 26 Feb 2021 11:25:04 +0000</pubDate>
				<category><![CDATA[Machine Learning]]></category>
		<category><![CDATA[companies]]></category>
		<category><![CDATA[fail]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[Strategies]]></category>
		<category><![CDATA[Why]]></category>
		<guid isPermaLink="false">http://www.aiuniverse.xyz/?p=13115</guid>

					<description><![CDATA[<p><img width="300" height="150" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-300x150.jpg" class="attachment-medium size-medium wp-post-image" alt="Why machine learning strategies fail" decoding="async" loading="lazy" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-300x150.jpg 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-1024x512.jpg 1024w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-768x384.jpg 768w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy.jpg 1200w" sizes="auto, (max-width: 300px) 100vw, 300px" /></p>
<p>Source &#8211; https://venturebeat.com/ Most companies are struggling to develop working artificial intelligence strategies, according to a new survey by cloud services provider Rackspace Technology. The survey, which includes 1,870 organizations in a variety of industries, including manufacturing, finance, retail, government, and healthcare, shows that only 20 percent of companies have mature AI/machine learning initiatives. The <a class="read-more-link" href="https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/">Read More</a></p>
<p>The post <a href="https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/">Why machine learning strategies fail</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></description>
										<content:encoded><![CDATA[<p><img width="300" height="150" src="https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-300x150.jpg" class="attachment-medium size-medium wp-post-image" alt="Why machine learning strategies fail" decoding="async" loading="lazy" srcset="https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-300x150.jpg 300w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-1024x512.jpg 1024w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy-768x384.jpg 768w, https://www.aiuniverse.xyz/wp-content/uploads/2021/02/cloud-machine-learning-strategy.jpg 1200w" sizes="auto, (max-width: 300px) 100vw, 300px" /></p>
<p class="wp-block-paragraph">Source &#8211; https://venturebeat.com/</p>



<p class="wp-block-paragraph">Most companies are struggling to develop working artificial intelligence strategies, according to a new survey by cloud services provider Rackspace Technology. The survey, which includes 1,870 organizations in a variety of industries, including manufacturing, finance, retail, government, and healthcare, shows that only 20 percent of companies have mature AI/machine learning initiatives. The rest are still trying to figure out how to make it work.</p>



<p class="wp-block-paragraph">There’s no questioning the promises of machine learning in nearly every sector. Lower costs, improved precision, better customer experience, and new features are some of the benefits of applying machine learning models to real-world applications. But machine learning is not a magic wand. And as many organizations and companies are learning, before you can apply the power of machine learning to your business and operations, you must overcome several barriers.</p>



<p class="wp-block-paragraph">Three key challenges companies face when integrating AI technologies into their operations are in the areas of skills, data, and strategy, and Rackspace’s survey paints a clear picture of why most machine learning strategies fail.</p>



<h2 class="wp-block-heading">Machine learning is about data</h2>



<p class="wp-block-paragraph">Machine learning models live on compute resources and data. Thanks to a variety of cloud computing platforms, access to the hardware needed to train and run AI models has become much more accessible and affordable.</p>



<p class="wp-block-paragraph">But data continues to remain a major hurdle in different stages of planning and adopting an AI strategy. Thirty-four percent of the respondents in the Rackspace survey stated poor data quality as the main reason for the failure of machine learning research and development, and another 31 percent said they lacked production-ready data.</p>



<p class="wp-block-paragraph">This highlights one of the main hurdles when applying machine learning techniques to real-world problems. While the AI research community has access to many public datasets for training and testing their latest machine learning technologies, when it comes to applying those technologies to real applications, getting access to quality data is not easy. This is especially true in industrial, health, and government sectors, where data is often scarce or subject to strict regulations.</p>



<p class="wp-block-paragraph">Data problems crop up again when machine learning initiatives move from the research to the production phase. Data quality remains the top barrier when it comes to using machine learning to extract valuable insights. Data engineering problems also pose a significant problem, such as data being siloed, lack of talent to connect disparate data sources, and not being fast enough to process data in a meaningful way.</p>



<p class="wp-block-paragraph">Both startups and established companies suffer from data problems, though scale seems to be the key differentiator between the two, according to Jeff DeVerter, CTO of Rackspace Technology. “Startups tend to be constrained with not all the right resources to implement a quality data pipeline and consistently managing it over time,” DeVerter said to TechTalks in written comments. “Enterprises usually have scale on their side and with that comes the rigor that’s required.”</p>



<p class="wp-block-paragraph">The best way companies can prepare for the data challenges of AI strategies is to do a full evaluation of their data infrastructure. Eliminating silos should be a key priority in every machine learning initiative. Companies should also have the right procedures for cleaning their data to improve the accuracy and performance of their machine learning models.</p>



<h2 class="wp-block-heading">AI talent is still in high demand</h2>



<p class="wp-block-paragraph">The second area of struggle for most companies is access to machine learning and data science talent. According to Rackspace’s survey, lack of in-house expertise was the second biggest driver of failure in machine learning R&amp;D initiatives. Lack of skill and difficulty in hiring was also a key barrier in adopting AI technologies.</p>



<p class="wp-block-paragraph">With machine learning and deep learning having reached mainstream use in production environments only recently, many smaller companies don’t have data scientists and machine learning engineers who can develop AI models.</p>



<p class="wp-block-paragraph">And the average salary of data scientists and machine learning engineers matches those of experienced software engineers, which makes it difficult for many companies to put together a talented team that can lead its AI initiative.</p>



<p class="wp-block-paragraph">While the shortage of machine learning and data science talent is well known, one thing that has gone mostly unnoticed is the need for more data engineers, the people who set up, maintain, and update databases, data warehouses, and data lakes. Per Rackspace’s figures, many initiatives fail because companies don’t have the talent to adapt their data infrastructure for machine learning purposes. Breaking down silos, migrating to cloud, setting up Hadoop clusters, and creating hybrid systems that can leverage the power of different platforms are some areas where companies are sorely lacking. And these shortcomings prevent them from making company-wide deployments of machine learning initiatives.</p>



<p class="wp-block-paragraph">With the development of new machine learning and data science tools, the talent problem has become less intense. Google, Microsoft, and Amazon have launched platforms that make it easier to develop machine learning models. An example is Microsoft’s Azure Machine Learning service, which provides a visual interface with drag-and-drop components and makes it easier to create ML models without coding. Another example is Google’s AutoML, which automates the tedious process of hyperparameter tuning. While these tools are not a replacement for machine learning talent, they lower the barrier for people who want to enter the field and will enable many companies to reskill their tech talent for these growing fields.</p>



<p class="wp-block-paragraph">“Lack of in-house data science talent is not the barrier it once was now that more of these services are able to use their own ML to help in this regard as well consulting firms having these talents on-staff,” DeVerter said.</p>



<p class="wp-block-paragraph">Other developments in the field are the evolution of cloud storage and analysis platforms, which have considerably reduced the complexity of creating the seamless data infrastructures needed to create and run AI systems. An example is Google’s BigQuery, a cloud-based data warehouse that can run queries across vast amounts of data stored in various sources with minimal effort.</p>



<p class="wp-block-paragraph">We’re also seeing growing compatibility and integration capabilities in machine learning tools, which will make it much easier for organizations to integrate ML tools into their existing software and data ecosystem.</p>



<p class="wp-block-paragraph">Before entering an AI initiative, every organization must make a full evaluation of in-house talent, available tools, and integration possibilities. Knowing how much you can rely on your own engineers and how much it will cost you to hire talent will be a defining factor in the success or failure of your machine learning initiatives. Also, consider whether re-skilling is a possible course of action. If you can upskill your engineers to take on data science and machine learning projects, you will be better off in the long run.</p>



<h2 class="wp-block-heading">Outsourcing AI talent</h2>



<p class="wp-block-paragraph">Another trend that has seen growth in recent years is the outsourcing of AI initiatives. Only 38 percent of the Rackspace survey respondents relied on in-house talent to develop AI applications. The rest were either fully outsourcing their AI projects or employing a combination of in-house and outsourced talent.</p>



<p class="wp-block-paragraph">There are now several companies that specialize in developing and implementing AI strategies. An example is C3.ai, an AI solutions provider that specializes in several industries. C3.ai provides AI tools on top of existing cloud providers such as Amazon, Microsoft, and Google. The company also provides AI consultancy and expertise to take customers step by step through the strategizing and implementation phases.</p>



<p class="wp-block-paragraph">According to the Rackspace report: “A mature provider can bring everything from strategy to implementation to maintenance and support over time. Strategy can sidestep the areas where AI and machine learning efforts may lose momentum or get lost in complexity. Hands-on experts can also spare organizations from the messy work of cleanup and maintenance. Such expertise, taken together, can make all the difference in finally achieving success.”</p>



<p class="wp-block-paragraph">It is worth noting, however, that fully turning over an organization’s AI strategy to outside providers can be a double-edged sword. A successful strategy requires close cooperation between AI specialists and subject matter experts from the company that is implementing the strategy.</p>



<p class="wp-block-paragraph">“This is very similar to companies who move to a DevOps development methodology and attempt to outsource the entirety of the development. DevOps requires a close partnership between the developers, business analysts, and others in the business,” DeVerter said. “In the same way, AI projects require strategy and technical expertise — but also require a tight partnership with the business as well as leadership.”</p>



<p class="wp-block-paragraph">Outsourcing AI talent must be done meticulously. While it can speed up the process of developing and implementing an AI strategy, you must make sure that your experts are fully involved in the process. Ideally, you should be able to develop your own in-house team of data scientists and machine learning engineers as you work with outside experts.</p>



<h2 class="wp-block-heading">How do you evaluate your AI strategy?</h2>



<p class="wp-block-paragraph">Finally, another area that is causing much pain for companies embarking on an AI journey is forecasting the outcome and value of AI strategies. Given the application of machine learning being new to many areas, it’s hard to know in advance how long an AI strategy will take to plan and implement and what the return on investment will be. This in turn makes it difficult for innovators in organizations to get others on board when it comes to garnering support for AI initiatives.</p>



<p class="wp-block-paragraph">Of the respondents of the Rackspace survey, 18 percent believed that a lack of clear business case was the main barrier to adopting AI strategies. Lack of commitment from executives was also among the top barriers. Lack of use cases and commitment from senior management show up again among the top challenges in the machine learning journey.</p>



<p class="wp-block-paragraph">“AI often wanders around as a solution looking for a problem within organizations. I believe this is one of the greatest impediments to its wide-scale adoption within organizations,” DeVerter said. “As AI practitioners can demonstrate practical examples of how AI can benefit their specific company — leadership will further fund those activities. Like any business venture — leadership needs to know how it will either help them save or make money.”</p>



<p class="wp-block-paragraph">Evaluating the outcome of AI initiatives is very difficult. According to the survey, the top-two key performance indicators (KPI) for measuring the success of AI initiatives were profit margins and revenue growth. Understandably, this focus on quick profits is partly due to the high costs of AI initiatives. According to the Rackspace survey, organizations spend a yearly average of $1.06 million on AI initiatives.</p>



<p class="wp-block-paragraph">But while a good AI initiative should result in revenue growth and lower costs, in many cases, the long-term value of machine learning is the development of new use cases and products.</p>



<p class="wp-block-paragraph">“Short-term financial gains can be myopic if they aren’t paired with a long-term strategy that can be funded by those short-term gains,” DeVerter said.</p>



<p class="wp-block-paragraph">If you’re in charge of the AI initiative in your organization, make sure to clearly lay out the use cases, the costs, and the benefits of your AI strategy. Decision-makers should have a clear picture of what their company will be embarking on. They should understand the short-term benefits of investing in AI, but they should also know what they will gain in the long run.</p>



<p class="wp-block-paragraph"><em>Ben Dickson is a software engineer and the founder of TechTalks. He writes about technology, business, and politics. This post was originally published here as a series exploring the business of artificial intelligence.</em></p>
<p>The post <a href="https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/">Why machine learning strategies fail</a> appeared first on <a href="https://www.aiuniverse.xyz">Artificial Intelligence</a>.</p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.aiuniverse.xyz/why-machine-learning-strategies-fail/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
	</channel>
</rss>
