Join

Enter Details

Comment on stories, receive email newsletters & alerts.

@
This is your permanent identity for Gizmodo, Kotaku, Lifehacker and Business Insider Australia
Your email must be valid for account activation
Minimum of 8 standard keyboard characters

Subscribe

Great discounts, competitions and special offers from our partners.
Email newsletters aren't ready to go out just yet, but will contain a brief summary of our top stories, news alerts, plus details of competitions and reader events.
Having issues creating your account? Contact Support

Forgotten Password

Enter Details


Back to log in

CIA: Big Data Is The Future And The Agency Owns It [PRESENTATION]

giga

On Wednesday, the CIA’s chief technology officer detailed the Agency’s vision for collecting and analysing all of the information people put on the Internet.

The wide-ranging presentation at GigaOM’s Structure:Data conference in New York City came two days after it was reported the spy agency is on the verge of signing a cloud computing contract with Amazon — worth up to $600 million over 10 years — that involves Amazon Web Services helping the CIA build a “private cloud” filled with technologies like big data.

After laying out what the CIA does — i.e. collect intelligence, conduct analysis, perform covert action — CIA CTO Ira “Gus” Hunt detailed just how the agency plans to acquire, store, and analyse digital data on a massive scale.

You’re already a walking sensor platform,” Hunt said, referring to all of the information captured by smartphones. “You are aware of the fact that somebody can know where you are at all times, because you carry a mobile device, even if that mobile device is turned off. You know this, I hope? Yes? Well, you should.”

In fact Hunt noted that based on the sensors in a smartphone, someone can be identified (with 100 per cent accuracy) by the way they walk — implying that someone could be identified even when carrying someone else’s phone.

The challenge for the CIA is to find the relevance is the ocean of information when something happens. The first step is for “data scientists” to save and analyse all digital breadcrumbs — even the ones people don’t know they are creating (i.e. “More is always better”).

“Since you can’t connect dots you don’t have, it drives us into a mode of, we fundamentally try to collect everything and hang on to it forever,” Hunt said. “It is really very nearly within our grasp to be able to compute on all human generated information.” 

He ends with comments about how the “inanimate is becoming sentient,” how cognitive machines (e.g. Watson) are going to “explode upon us,” and how technology is moving faster than governments, legal systems, and even individuals can keep up.

The CIA's mission is to collect intelligence, conduct analysis, and perform covert action.

It's made some bets on what the future of technology will look like.

These are six things that will help realise those bets.

Then Facebook.

YouTube.

Twitter.

Global text messages.

Cellular calls in the U.S.

And the world population.

Combined with the emerging forces, nano, bio, and sensors, big data is driving three things: a dramatic increase in velocity of innovation (because work can be done from scratch); an acceleration of social change (e.g. Arab Spring); and an alteration of the global flow of information (i.e. from the few to the many to the many to the many).

The situation allows for the collection of vast amounts of information.

And the ability to relate the pieces to each other.

Here's how the Agency does it.

And here's what they keep in mind while doing it.

The challenge is connecting the dots when it's relevant to do so.

Which requires collecting as much data as possible.

And then sifting through it.

Which is where data science comes into play.

Data scientists build the tools needed to analyse the ocean of info.

Which gives more power to the machines.

Soon the CIA will be able to collect and analyse everything.

Which, in turn, leads to a world of cognitive machines with extraordinary capabilities.

And all of this is happening faster than humans can keep up with.

Here's the full 30-minute presentation

Now check out what this means for the future of crime

Follow Business Insider Australia on Facebook, Twitter, and LinkedIn