Edge computing plays a crucial role in supporting the future development of business.

As technology use has grown dramatically during the pandemic, producing increased volumes of significant business data, organizations are going to the edge to assist with speeding up growth and drive business transformation. Indeed, this is the data age, and data is produced at exponential levels. Notwithstanding, if the physical data storage devices for the cloud are far away from where the information is gathered, it is exorbitant to move this data on the grounds that the bandwidth costs are crazy and there is additionally a higher data latency. Enter Edge Computing.

According to a report by IDC, by 2025, 175 zettabytes (or 175 trillion gigabytes) of data will be created throughout the planet. Edge devices will make more than 90 zettabytes of that data.

This data explosion has triggered desperation among organizations hoping to expand their utilization of technologies like artificial intelligence (AI), edge computing, and 5G communications. Edge computing technology can play a crucial role in driving efficiencies and supporting the future development of business. Business leaders are addressing the infrastructure demands of upcoming technologies and the job that edge computing can do is driving competitive advantage through accelerated digital transformation. The edge is where organizations can transform their ideas into reality.

Edge cloud computing is significant on the grounds that it makes better ways for industrial and large-scale organizations to amplify operational effectiveness, enhance performance and safety, automate all core business processes, and guarantee consistent availability. It is a significant technique to undergo the digital transformation of how one can do business.

In a highly connected world, where workforces are dispersed, smart devices are multiplying and the quality of customer experiences is a higher priority than ever. Hence, latency matters. High latency intrudes data flow and reduces application performance, which can affect business processes.

Edge computing technology moves computation and storage resources nearer to where data is produced and consumed, decreasing the distance that significant data needs to travel. This diminishes latency, speeds up the accessibility of data, mitigates bandwidth pressure, and reduces the expense of supporting the movement of massive amounts of data.

Edge computing applications are additionally assisting with providing exceptional patient care and improving the efficiency of medical services in healthcare by empowering incessant patient monitoring and data collection, incorporation of electronic health records, and AI-powered patient data analysis. Deep learning is utilized in image-based diagnostics to speed up the identification of medical problems and save lives. With edge computing, Philips figured out how to speed CT scan imaging by 188 times without the need for hardware acceleration.

Edge cloud computing works inseparably with the cloud to give a flexible solution depending on the data collection and analysis needs of every enterprise. For real-time collection and analysis, the edge is ideal for specific jobs. Simultaneously, the cloud can give a concentrated location for large-scale analytics. Together they give real-time and longer-term insights into performance and other initiatives like machine learning and asset performance management.

Edge computing devices can also accelerate the development of smart cities. Smart cities rely upon gigantic sources of data and the inborn decentralization of Edge Computing is the ideal answer to prevent system collapses while simultaneously working on the effectiveness of all the elements of a smart city. Edge computing examples in smart cities include self-driving vehicles, smart grids, public transport, etc.

Many retail stores are also adopting different technologies. This implies that customers can swipe into the store with their smartphone application or a QR code and begin picking anything they desire to purchase. Then, customers can simply leave the store and the cost of whatever they have purchased will be automatically deducted from their balance or bank account. Retail stores can do this utilizing a blend of motion sensors and in-store cameras to analyze what all customers are purchasing.

In any case, this likewise requires edge computing as too much delay in data analysis can cause the customers to simply get stuff and leave for free! One edge computing example is the Amazon Go store which was launched in January 2018.

Presently, we are stretching out these advantages to the edge to improve operational productivity and further develop performance and safety, while decreasing unplanned downtime and cost. Edge computing can make our lives simpler, proficient, and more useful.

The post EDGE COMPUTING CAN ACCELERATE THE DEVELOPMENT OF INNOVATIVE WORLD appeared first on Artificial Intelligence.

Being able to deploy machine learning applications at the edge is the key to unlocking a multibillion-dollar market. TinyML is the art and science of producing machine-learning models frugal enough to work at the edge, and it’s seeing rapid growth.

Is it $61 billion and 38.4% compound annual growth rate (CAGR) by 2028 or $43 billion and 37.4% CAGR by 2027? Depends on which report outlining the growth of edge computing you choose to go by, but in the end it is not that different.

What matters is that edge computing is booming. There is growing interest by vendors, and ample coverage, for good reason. Although the definition of what constitutes edge computing is a bit fuzzy, the idea is simple. It is about taking compute out of the data center and bringing it as close to where the action is as possible.

Whether it’s stand-alone Internet-of-things sensors, devices of all kinds, drones, or autonomous vehicles, there’s one thing in common. Increasingly, data generated at the edge are used to feed applications powered by machine learning models. There’s just one problem: machine learning models were never designed to be deployed at the edge. Not until now, at least. Enter TinyML.

Tiny machine learning (TinyML) is broadly defined as a fast-growing field of machine-learning technologies and applications including hardware, algorithms, and software capable of performing on-device sensor data analytics at extremely low power, typically in the mW range and below, hence enabling a variety of always-on use-cases and targeting battery-operated devices.

This week, the inaugural TinyML EMEA Technical Forum is taking place, and it was a good opportunity to discuss with some key people in this domain. ZDNet caught up with Evgeni Gousev from Qualcomm, Blair Newman from Neuton, and Pete Warden from Google.

Hey Google
Pete Warden wrote the world’s only mustache-detection image-processing algorithm. He also was the founder and chief technology officer of startup Jetpac. He raised a Series A from Khosla Ventures, built a technical team, and created a unique data product that analyzed the pixel data of more than 140 million photos from Instagram and turned them into in-depth guides for more than 5,000 cities around the world.

Jetpac was acquired by Google in 2014, and Warden has been a Google Staff Research Engineer since. Back then, Warden was feeling pretty good about himself for being able to fit machine-learning models in 2 megabytes.

That was until he found some of his new Google colleagues had a 13 kilobyte model that they were using to recognize wake words running on always-on digital signal processor
on Android devices. That way the main CPU wasn’t burning battery listening out for “that” wake word—Hey Google.

“That really blew my mind, the fact that you could do something actually really useful in that smaller model. And it really got me thinking about all of the other applications that might be possible if we can run especially all these new machine-learning, deep-learning approaches” Warden said.

Although Warden is oftentimes credited by his peers as having kickstarted the TinyML subdomain of machine learning, he is quite modest about it. Much of what he did, he acknowledges, was based off things others were already working on: “A lot of my contribution has been helping publicize and document a bunch of these engineering practices that have emerged,” he said.

The post Machine Learning at the Edge: TinyML Is Getting Big appeared first on Artificial Intelligence.

As the adoption of artificial intelligence (AI), deep learning, and big data analytics continues to grow, it is becoming increasingly important for edge computing systems to process large data sets in a timely and efficient manner. The basic compute, storage and networking capabilities are all present today at the edge, but speeds and capacity will only continue to increase and advancements like NVMe (Non Volatile Memory Express) will offer significant performance advantages and boost AI adoption at the edge.

Edge-based AI: Are We There Yet?

It is possible, and becoming easier, to run AI and machine learning with analytics at the edge today, depending on the size and scale of the edge site and the particular system being used.

While edge site computing systems are much smaller than those found in central data centers, they have matured, and now successfully run many workloads due to an immense growth in the processing power of today’s x86 commodity servers. It’s quite amazing how many workloads can now run successfully at the edge.

For example, many large retailers are using edge computing solutions today because it is cost-prohibitive to send data to the cloud for processing, and the cloud is not able to keep up with retailers real-time demands. They are running local analytics applications as well as AI algorithms at these edge sites.

While the basic compute, storage, and networking capabilities are “there” today, we anticipate they will continue to improve over time to allow for more workloads to run successfully at the edge. Processing speeds and storage capacities will continue their torrid pace.

For instance, one advancement that is making its way to the edge is NVMe . This new protocol offers significant performance advantages for solid state disks (SSDs) since they communicate directly on the PCIe bus. Legacy spinning disk drives primarily use the SATA interface, which is much slower and designed for performance characteristics of spinning disks and not for the “new age” storage of flash memory (used within SSDs).

As NVMe adoption continues to rise, SSD-based edge sites with NVMe protocol will be able to scale to meet the needs of AI processing. Deploying edge computing solutions with NVMe provides the increased performance that is needed for artificial intelligence, machine learning and big data analytics.

Overcoming Cost Barriers for AI at the Edge

As AI adoption moves forward and more data is created outside the primary data center, the key challenge will be cost. It’s easy to design an edge computing system to support AI and machine learning applications. However,  it’s extremely pricey. Cost is a paramount concern for edge deployments, since there are likely many sites to provision. When you’re multiplying the cost of one edge site by 1,000 or 2,000 sites, the total cost escalates quickly.

To keep edge computing costs down to support AI, machine learning, and big data analytics, IT generalists should seek to:

• Deploy software-based virtual storage area network (SAN) technology, instead of physical equipment. The software-defined storage offerings available today eliminate the need for expensive external storage systems, and instead leverage the storage inside the servers. Again, this is especially important for edge environments with dozens, hundreds, or even thousands of sites.
• Find simple solutions that require as few servers as possible. Many edge computing systems today still require three or more servers in order to build a highly available system. Look for solutions that only require two servers to control costs, but still maintain availability.
• Be able to manage many locations centrally. Onsite management at edge sites is a huge problem because there typically is no IT staff available at each site. Edge computing systems require deployment and management from a single remote location.

Technical Requirements for AI at the Edge

Data encryption is becoming more and more important at the edge, and the technology is maturing to make it effective from cost and performance perspectives.

One processor feature that is also becoming more important is the encryption offload engine. This is a specific instruction deployed via dedicated hardware accelerators that process the encryption algorithms exclusively, thereby minimizing the impact on the CPU running the main application. The most common offload engine is called AES-NI (Advanced Encryption Standard New Instruction), as used by Intel and AMD.

While the brand and model of processors no longer matters in today’s world, to be able to support AI, machine learning, and big data analytics workloads, an organization would typically want to use a processor with a speed of at least 2.1GHz to 2.4GHz, and preferably with 10 -14 cores.

Tiered storage/caching is also required to enable data to automatically move between storage tiers (spinning disk drives, SSDs and in some cases – system memory) as its importance changes. For instance, when the edge computing system is running a big data project, all of the relevant data would move to the fastest SSD, but when that data isn’t being used it will move to the less expensive spinning disks.

In order to run multiple applications on these small yet powerful edge computing systems, a hypervisor is required to easily share the processing power of each server. The most popular hypervisors are VMware vSphere, Microsoft is Hyper-V, and open-source KVM for Linux-based systems.

All of these technologies are available today and will help propel the adoption of AI on edge computing devices.

Why AI at the Edge?

Organizations will continue to address AI data management challenges by architecting powerful and highly available edge computing systems, which will lower customer costs. New technologies that were previously cost-prohibitive will become more viable over time, and find uses in new markets. Take the following use cases as examples:

• Self-driving cars are a great example as each car can be considered its own edge computing site and must make real-time decisions on the data being collected in real-time. There simply isn’t enough time to send data to a cloud somewhere for processing.
• Airplane monitoring is also more common for modern aircraft that deploy thousands of sensors that generate massive amounts of data. In some cases, there could be 300,000 sensors generating over 1 petabyte of data per flight. This data needs immediate processing to make flight corrections and to ensure passenger safety.
• Smart Cities are another booming AI use case, as many municipalities are moving towards an abundance of traffic sensors, video surveillance cameras, and other monitoring devices throughout the city. This data is being collected in many locations and needs to be analyzed in real-time to make decisions to keep traffic moving and their population safe from crime.

Previously, powerful AI apps required large, expensive data center-class systems to operate. But edge computing devices can reside anywhere, as demonstrated in the above use cases. AI at the edge offers endless opportunities that a can help society in ways never before imagined.

The post Exploring Artificial Intelligence at the Edge appeared first on Artificial Intelligence.