Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

Bing gets a performance boost from reconfigurable chips

In a project called Catapult, Microsoft is using field-programmable chips to speed up certain tasks

Article comments

Microsoft is planning to use programmable chips to boost the performance of the servers for its Bing search engine, by accelerating certain services using these devices.

The project, called Catapult, used field-programmable gate arrays, or FPGAs, which as the name suggests can be configured by customers on the field after they are manufactured. FPGAs are now seen as powerful computing devices in their own right, which can be used for accelerating certain programmable tasks, researchers working on the project said.

The new approach is likely to be important for compute-intensive services like Bing as Microsoft can now selectively speed up large-scale services, such as its ranking throughput, by adding FPGA compute boards to servers, rather than buy more hardware and CPUs to run the workloads.

The rate at which server performance improves has slowed considerably, as performance gains from CPUs flatten, wrote Microsoft researchers and colleagues from Bing, the industry and academia in a paper presented on Monday to the 41st International Symposium on Computer Architecture, which describes a bid to combine programmable hardware and software using FPGAs to boost ranking throughput by as much as 95 percent.

Adding the FPGA boards increased power consumption by only 10 percent and did not exceed the researchers' 30 percent limit in the total cost of ownership of an individual server, indicating that the new architecture could deliver key savings and efficiencies, according to the researchers.

The paper describes the testing across 1,632 servers of the reconfigurable fabric of interconnected nodes linked by high bandwidth connections, and measuring its efficacy in accelerating the workload in a production search infrastructure. The use of the FPGAs does not do away with CPUs, but only offloads certain workloads to the configurable chips.

Instead of moving functions to custom designed chips, known as application-specific integrated circuits, the researchers mapped them to the reconfigurable FPGAs from a company called Altera, in the bargain designing what is described as a 'programmable hardware' enhanced cloud.

The researchers decided against using GPUs (graphics processing units), although both FPGAs and GPUs support high parallelism with hundreds to thousands of arithmetic units available on each chip, because the current power requirements of high-end GPUs are too high for conventional data center servers and also because it wasn't clear whether some latency-sensitive ranking stages, such as feature extraction, would map well to GPUs, the researchers wrote.

"Going into production with the new technology will be a watershed moment for Bing search," Microsoft Research head Peter Lee said in a blog post. For the first time ever, the quality of Bing's page ranking will be driven not only by great algorithms but also by highly specialized hardware, he added.

"We conclude that distributed reconfigurable fabrics are a viable path forward as increases in server performance level off, and will be crucial at the end of Moore's Law for continued cost and capability improvements," the researchers wrote. The law is named after Intel's cofounder Gordon Moore who observed that the number of transistors in an integrated circuit would double every two years.



Share:

More from Techworld

More relevant IT news

Comments



Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *