• Tech News
    • Games
    • Pc & Laptop
    • Mobile Tech
    • Ar & Vr
    • Security
  • Startup
    • Fintech
  • Reviews
  • How To
What's Hot

Elementor #32036

January 24, 2025

The Redmi Note 13 is a bigger downgrade compared to the 5G model than you might think

April 18, 2024

Xiaomi Redmi Watch 4 is a budget smartwatch with a premium look and feel

April 16, 2024
Facebook Twitter Instagram
  • Contact
  • Privacy Policy
  • Terms & Conditions
Facebook Twitter Instagram Pinterest VKontakte
Behind The ScreenBehind The Screen
  • Tech News
    1. Games
    2. Pc & Laptop
    3. Mobile Tech
    4. Ar & Vr
    5. Security
    6. View All

    Bring Elden Ring to the table with the upcoming board game adaptation

    September 19, 2022

    ONI: Road to be the Mightiest Oni reveals its opening movie

    September 19, 2022

    GTA 6 images and footage allegedly leak

    September 19, 2022

    Wild west adventure Card Cowboy turns cards into weird and silly stories

    September 18, 2022

    7 Reasons Why You Should Study PHP Programming Language

    October 19, 2022

    Logitech MX Master 3S and MX Keys Combo for Business Gen 2 Review

    October 9, 2022

    Lenovo ThinkPad X1 Carbon Gen10 Review

    September 18, 2022

    Lenovo IdeaPad 5i Chromebook, 16-inch+120Hz

    September 3, 2022

    It’s 2023 and Spotify Still Can’t Say When AirPlay 2 Support Will Arrive

    April 4, 2023

    YouTube adds very convenient iPhone homescreen widgets

    October 15, 2022

    Google finishes iOS 16 Lock Screen widgets rollout w/ Maps

    October 14, 2022

    Is Apple actually turning iMessage into AIM or is this sketchy redesign rumor for laughs?

    October 14, 2022

    MeetKai launches AI-powered metaverse, starting with a billboard in Times Square

    August 10, 2022

    The DeanBeat: RP1 simulates putting 4,000 people together in a single metaverse plaza

    August 10, 2022

    Improving the customer experience with virtual and augmented reality

    August 10, 2022

    Why the metaverse won’t fall to Clubhouse’s fate

    August 10, 2022

    How Apple privacy changes have forced social media marketing to evolve

    October 16, 2022

    Microsoft Patch Tuesday October Fixed 85 Vulnerabilities – Latest Hacking News

    October 16, 2022

    Decentralization and KYC compliance: Critical concepts in sovereign policy

    October 15, 2022

    What Thoma Bravo’s latest acquisition reveals about identity management

    October 14, 2022

    What is a Service Robot? The vision of an intelligent service application is possible.

    November 7, 2022

    Tom Brady just chucked another Microsoft Surface tablet

    September 18, 2022

    The best AIO coolers for your PC in 2022

    September 18, 2022

    YC’s Michael Seibel clarifies some misconceptions about the accelerator • DailyTech

    September 18, 2022
  • Startup
    • Fintech
  • Reviews
  • How To
Behind The ScreenBehind The Screen
Home»Tech News»Storage the key bottleneck for AI processing
Tech News

Storage the key bottleneck for AI processing

September 4, 2022No Comments4 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
Storage the key bottleneck for AI processing
Share
Facebook Twitter LinkedIn Pinterest Email

We talk to Jeff Whitaker, vice-president for product marketing at scale-out NAS maker Panasas, about why storage is the key bottleneck in artificial intelligence (AI) processing.

In this podcast, we look at the key requirements of AI processing and how paying attention to the storage it requires can bring benefits.

Whitaker talks about the need to get lots of data into AI compute resources quickly and how some are tempted to throw compute at the problem. Instead, he argues that attention should be paid to storage that has the right throughput and latency performance profiles to deal with lots of small files, as found in AI

Antony Adshead: What are the challenges organisations face when it comes to storage for high-performance applications?

Jeff Whitaker: When it comes to high-performance applications…the application is trying to get to results fast. It’s trying to get to a decision, trying to get information back for the environment that is using the application.

There’s often a heavy reliance on the compute side of this, and sometimes an over-reliance. A lot of times that can be figured out, that can be resolved by [asking], what [does] a typical application environment look like? It’s compute, it’s network and it’s storage.

And I say storage third because often storage is the last thing that’s thought about on trying to get performance out of an application environment.

One of the things we like to look at is, when it comes to an application, what are the data needs? What kind of throughput is required, what kind of latencies are required, what is it going to take for that application to run as efficiently as possible?

See also  Unstructured knowledge storage – on-prem vs cloud vs hybrid

And often, customers and partners have looked at solving the challenge by throwing more compute at making the applications faster, but really the bottleneck comes around storage.

It’s important for people to understand when it comes to their environment they should look at the data needs before they go and try to solve the problem with just compute.

So, it’s really a matter of trying to build an efficient environment to get the results they need. They need to look at what type of a storage environment can solve the challenges of their application.

 

Adshead: What are the key trends you are seeing, particularly around the convergence of high-performance computing (HPC) with high-end enterprise storage, artificial intelligence and machine learning?

Whitaker: HPC has traditionally been an application environment that needs a lot of data. And a lot of times, the storage environment needs to be something special that can scale and address the throughput so that the compute doesn’t just sit there idle. It needs a lot of data coming in there.

What we’ve started to see with the AI world and getting beyond just the development and coming up with ideas, they’re essentially applications. An AI environment is trying to process a lot of data and get to a result, especially during the training process there’s tonnes of data being pumped into compute. So, in this case it’s often GPUs [graphics processing units] that are used and those are expensive and no one wants to sit there and have those idle.

So, how fast you can pump the data into an AI environment is critical to how fast the application can run or the AI training can run. If you look at it, it’s almost on a par with what an HPC environment typically looks like where you’re ingesting a tonne of data trying to get a result, so you really need to look at what those data needs are for that training process or for the different types of HPC workloads and try to solve the challenge from there.

See also  Instagram to start testing a repost feature

The one difference that we see here is often in an HPC world, we see very large files being pumped into the compute. Whereas in the AI side, we see tonnes of smaller files being pumped into the compute.

And really the bottleneck becomes how fast can you get that data into the compute so you can get to a result.

And really going out there and saying can a traditional enterprise storage environment solve that need for you?

It’s latency, it’s throughput. Traditional environments have the ability to have small latency, but trying to get very scalable throughput is very challenging and that’s when we start to look at different type of architecture like parallel solutions that can scale consistently, depending on how much performance you need, really solving that challenge of ingesting tonnes of data into those compute environments.

Source link

bottleneck key processing storage
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

3 Key Startup Opportunities In Remote Work

September 18, 2023

10 Key Rules To Improve Your Website’s User Experience

August 9, 2023

Why ChatGPT Could Be Making Us Smarter: 6 Key Reasons

July 20, 2023

Online Reputation Management Is Key To Thriving Post-Google Updates

July 6, 2023
Add A Comment

Comments are closed.

Editors Picks

Madrona backs WaFd Bank spinout developing consumer software for regional banks – Startup

March 6, 2023

Making sense of the market proper now with Danny Rimer of Index Ventures – DailyTech

July 16, 2022

The Sims 4’s Excessive College Years replace has added some deeply unlucky bugs

July 30, 2022

World of Warcraft: Wrath of the Lich King Basic arrives on September 26

July 26, 2022

Subscribe to Updates

Get the latest news and Updates from Behind The Scene about Tech, Startup and more.

Top Post

Elementor #32036

The Redmi Note 13 is a bigger downgrade compared to the 5G model than you might think

Xiaomi Redmi Watch 4 is a budget smartwatch with a premium look and feel

Behind The Screen
Facebook Twitter Instagram Pinterest Vimeo YouTube
  • Contact
  • Privacy Policy
  • Terms & Conditions
© 2025 behindthescreen.uk - All rights reserved.

Type above and press Enter to search. Press Esc to cancel.