Delivering Technology Industry Data Without Friction

Supplier Spotlight

International Data Corporation (IDC)
International Data Corporation. Crux Supplier Spotlight Series

What is the background on IDC? 

IDC has been in business for over 50 years. We do comprehensive and very deep research on the Technology industry. 

The bulk of IDC’s business is with large technology vendors who rely on IDC’s industry data and research to make strategic decisions around product development, competitive positioning, new investment opportunities, market entry, product positioning, etc. IDC has also been working with financial clients for many, many years. On the buy-side, that tends to be investors doing deep fundamental work in the tech space, namely long/short discretionary hedge funds, activists, and private equity clients.

What are IDC’s key benefits for clients? 

IDC has unique and highly structured data that cannot be found in SEC filings, company disclosures, on the internet, or elsewhere in the public domain. IDC data sets provide an independent, comprehensive, and coherent picture of technology markets worldwide, which is understood by our clients to be the best proxy for ground truth available.

This is a good point to speak to the key categories of data that IDC offers. What schemas does IDC utilize (frequency, type, etc.)?

IDC has 25 distinct data sets (called Trackers) oriented around various worldwide technology markets (e.g. Mobile Phones, PCs, Servers, Storage, Switches & Routers, Public Cloud Services, Cloud Infrastructure, Software, etc.). Collectively, IDC covers nearly 3,000 technology firms globally, of which over 600 are publicly traded. The data offers comprehensive and very granular insight into Tech-industry fundamentals (e.g. revenue, unit shipments & capacity shipments by vendor, segment, country, price band, channel, form factor, etc.). 

From a geographic standpoint, IDC has country-level data on up to 110 countries. The frequency of the data is monthly, quarterly, or semiannually, depending on the data set. Historical data varies by technology market depending on the maturity of the technology and typically extends back close to the inception of the market. For instance, PC data goes back to 1995, while Mobile Phone data extends back to 2004. IDC’s tracker data is supported by detailed industry taxonomies and underpinned by a rigorous data collection methodology involving a top-down and bottom-up approach, where data is reconciled with direct contacts with leading technology vendors reviewing information gathered from our extensive regional and local relationships, resources, and data sources.

IDC has more than 1,100 technology analysts and research offices in over 50 countries. We leverage a multitude of data sources, including published financial statements and public data, import records, contract details, 3rd-party data from OEMs, component vendors, platform suppliers, and other channel and supply-chain constituents. IDC also curates information from distributor data feeds, import/export records, and pricing data scraped from the web. IDC analysts have over 85,000 vendor client interactions every year and leverage extensive consumer and B2B surveys, with over 350,000 respondents annually.

Can you provide examples of questions that a data consumer might be interested in answering with IDC data?

IDC helps investors understand the size, structure, and competitive and growth dynamics of various tech markets. The questions can include: Who is winning in particular market segments and geographies? Who is gaining traction in various channels? What are the key form factor trends, and pricing dynamics? How many units or how much capacity is being shipped? What is the size and age of the installed base and who/what is vulnerable for displacement by new technologies and competing vendors? Which workloads are moving to the cloud and which still have longevity with on-premise deployments? What architectures and components are being used in new data center construction? Which vendors sold what devices at what prices through which channels last month in China?

Historically, our discretionary clients are using IDC’s tracker data to build sophisticated market models to identify market share gainers and donors to surface long/short ideas and paired trades. The newer quant-oriented use cases might focus on sector rotation (e.g. overweight/underweight Tech), segment rotation within Tech (e.g. Semis vs Software), using market-share data to enhance “quality” factors in factor models,  or even using tracker data as inputs for global macro insights.

So you’ve traditionally worked with technology focused investors, what are some trends you’re seeing with them?

Over the past couple years, we’ve seen our traditional clients becoming increasingly focused on extracting insights from data in more efficient and often more automated ways. On an individual level, investment analysts are becoming more adept with programming languages, statistics packages, and analytical tools, so they are doing heavier lifting with large amounts of raw data. Many discretionary firms are creating centralized functions with data science teams to help fundamental analysts with screening, idea generation, and/or new quant-based insights into existing holdings. Some firms are embedding quants with their fundamental teams. Overall, fundamental analysis is becoming more data intensive and automated. 

At the same time, IDC is working with clients that have full-blown quantitative and systematic mandates. Interestingly, these firms are trying to find ways to acquire more domain expertise, and we can help them do that. So, these previously distinct skill sets (quant/systematic and fundamental/discretionary) are converging along a spectrum of capabilities and mandates. These evolving discretionary use cases and new systematic clients all require more automated, precise and timely delivery of data in various formats. 

We spoke about duplication of work in the past, can you tell me a little more about this?

For IDC customers and prospective customers, their technical folks may encounter a learning curve and upfront work to understand how to ingest our data into their processes. This requires a lot of back-and-forth with IDC’s technical folks. This happens across all of IDC’s clients for all the data vendors they work with. This multiplicative effect is time-consuming and strains their internal technical staff which ultimately inhibits IDC’s clients’ ability to scale their data onboarding, ingestion, and production operations. 

When it comes to ingesting data, can you elaborate on that?

Each of these new and evolving use cases require different delivery requirements of raw data to our clients – flat files via FTP, cloud buckets, or APIs. In addition to delivery, on IDC’s end, there is a lot of work that goes into the preparation of data to take it from raw form to a form that is actionable. This is where Crux comes into play. 

Let’s talk quickly about your experience working and delivering data with Crux?

The two pieces that Crux is helping to address for IDC and IDC’s clients are:

  • The back and forth friction that is required to get a new data set stood up and
  • The ability for our clients to ingest the data into their systems in the format(s) they want

We’re still ramping up our relationship with Crux and just finished the first part, but we’re excited to now be able to deliver our data sets through a variety of file formats quickly to our clients. Onboarding our datasets with the Crux team was relatively painless.

What does the future hold for IDC?

Overall, we think IDC data provides a perfect framework and foundation for creating complex data ensembles or unlocking the value of higher-frequency alternative data in the Tech space. In fact, Yin Luo’s Quantitative Research group at Wolfe Research back tested our data and wrote a report last year on some potential applications of IDC data for systematic investors that is very interesting. In our view, IDC data is still tremendously underutilized by Buy-side clients, particularly for these new types of use cases. Now that we’re working with Crux, our existing and potential clients have a streamlined way to explore, test, ingest, and ultimately exploit IDC data, and we’re very excited about that.

Q&A conducted with Brian Murphy, Director, Financial Sales at IDC.



About Supplier Spotlight Series


In our mission to help data flow efficiently between data suppliers and data consumers, we look to highlight major trends and developments impacting both parties. The ‘Supplier Spotlight’ series is an impactful content series focused on sharing the latest developments by suppliers and their datasets delivered by Crux.

To receive these updates, join our community.

Welcome MT Newswires to Crux!

MT Newswires Datasets on Crux

MT Newswires datasets now delivered by Crux! MT Newswires is a recognized leader in original, unbiased business and financial news. Offering over 130 unique categories of noise-free coverage, MT Newswires’ multi-asset class global news powers most of the industry’s most recognized platforms. Get datasets delivered here.

Crux Informatics Expands Data Delivery Reach to AWS Data Exchange

Crux on AWS Data Exchange

NEW YORK, Nov. 14, 2019 /PRNewswire/ — Crux Informatics (“Crux”), a leading data delivery and operations company, today announced it has joined the newly-launched AWS Data Exchange service from Amazon Web Services (AWS). AWS Data Exchange, is a service that makes it easy for millions of AWS customers to securely find, subscribe to, and use third-party data in the cloud. Availability on AWS Data Exchange further delivers on Crux’s mission to make reliable data from suppliers accessible for consumers around the globe.

Companies today are faced with the challenge of ingesting complex data from a wide variety of suppliers at scale, resulting in significant time and resource investments. As the industry utility that simplifies the data ingestion, operations, and delivery process, Crux ensures that data flows seamlessly between suppliers and financial companies, so they can focus their resources on extracting value from the data. Customers using AWS Data Exchange and the AWS Marketplace are now able to easily access validated data from Crux, and data suppliers can leverage Crux’s capabilities to distribute on AWS Data Exchange.

“Data suppliers and their customers across financial services have told us they want to work with Crux to connect and operate with data sets at scale so we are delighted to welcome Crux to AWS Data Exchange to feed data into customer’s applications, analytics, and machine learning models running on AWS,” said Samantha Gibson, Head of Financial Services Business Development, AWS Data Exchange, Amazon Web Services, Inc. “As our customers continue to move to the cloud, they’re looking for new ways to simplify how they find and consume data and we are excited to see the innovation made possible by having diverse, high-quality, and well-curated data from Crux available on AWS Data Exchange.”

“We are proud to collaborate with AWS to deliver reliable, timely and digestible data into their innovative AWS Data Exchange,” said Philip Brittan, CEO at Crux Informatics. “With availability in AWS Data Exchange, we’re taking another step forward in giving our clients the ability to find and access the data they need with the high degree of operational excellence they’ve come to expect from Crux.”

As of today, AWS Data Exchange customers can access Crux-delivered data directly. See here a selection of over 70 free datasets available on AWS Data Exchange. At the same time, data suppliers can now work with Crux to connect and deliver their data in AWS Data Exchange. Crux takes care of onboarding, validating and reliably operating your data feeds onto AWS Data Exchange, enabling you to accelerate distribution and scale operational efficiency. Connect with us to get your data delivered today.

Crux Hits 1,000 Datasets!

Crux-dataset-partners

Crux Community,

We are very excited to announce we now have over 1,000 datasets (some small, some massive) pumping through our pipelines and being delivered to data consumers, with new datasets being added every day! We are honored to have partnerships with over 60 leading data suppliers of a wide range of valuable data. It has been a very busy year for us here at Crux. We are moving and growing fast. We officially launched our platform in March of this year (can’t believe it’s only been 7 months!) and since then we have been cementing partnerships, building data pipelines, growing the team, forging strategic relationships, and of course delighting customers.

As part of delighting customers, we have built out more ways for them to easily consume ingested, validated, and processed data from Crux: in addition to the RESTful API and Python client we launched earlier this year, we now have the ability to push data directly into a customer’s Snowflake or Amazon S3 account and we will shortly release the ability to execute SQL queries and create ODBC connections directly against Crux-delivered data in the cloud. Just as we keep wiring up more and more datasets, we will keep building out new ways for customer to easily get their hands on that data.

Our team has been growing fast to handle all this, especially in Engineering, and we have been thrilled to have Mark Etherington join us as CTO this summer. Mark and team have hit the ground running and are ramping up Crux capabilities fast on numerous fronts.

We know that macroeconomic data is fundamental to most activities in financial services. We are pleased to announce that we are offering free delivery of a collection of public macroeconomic datasets for all customers. If you are already using Crux, we hope you will find these datasets a nice value-add. If you are new to Crux, these datasets are a great way to get started with us. Connect with us to get access today.

Thank you all for being an engaged community. We learn from our conversations with you every day and that helps us continually improve on our quest to make data delightful.


All the best,
Philip

Welcome Vertical Knowledge to Crux!

Vertical Knowledge Datasets delivered by Crux

Vertical Knowledge datasets now delivered by Crux! Vertical Knowledge provides rich historical libraries of auto, retail, real estate, travel, business intelligence, and other open source collected web data. Combining the power of the Vertical Knowledge web collection engine with the flexibility and depth of the Crux data management platform transforms the way public sector and commercial institutions identify, reference, and analyze open source data to solve their most difficult business problems. Get datasets delivered here.

Welcome IDC to Crux!

IDC datasets on Crux

IDC’s global technology research data can now be delivered by Crux. IDC is the premier global provider of market intelligence, advisory services, & events for the information technology, telecommunications, and consumer technology markets. Learn more here.

Welcome GTCOM to Crux!

GTCOM Sentiment Data delivered by Crux

GTCOM-US and their JoveBird Sentiment Data now delivered by Crux! GTCOM’s advanced NLP & semantic computing technologies analyzes global news & social streams providing corporate users with comprehensive scenario-based solutions. Get datasets delivered from Crux.

Welcome 2iQ to Crux!

Very excited to welcome @2iqresearch and their insider transactions data onto the Crux Supplier Network! Their datasets cover a universe of over 8.1M transactions from over 200k insiders across a universe of 60k stocks in 50 countries. Learn more here.