Big Data scope and trends.

Why Data Science?

The field of Data Science/Data Analytics is quickly gaining new heights as a career path and everyday there are increasingly more budding data scientists and analysts joining the industry. According to a latest examination by McKinsey, predicting 140-190,000 open positions for ‘Big Data Job roles’ by 2018 in the United States alone.

And this need for data analysts expands across a wide range of industries, including technology, finance, consulting, government, manufacturing, pharmaceuticals, and medical applications. With the boosting era of technology, it has becomes possible for organizations to collect relevant information in a more efficient and economical manner, it has become more and more necessary to find professionals who are able to analyze and to interpret this ever-increasing amounts of data.

Role of a Data Scientist:-

A Data Scientist or a Data Analyst works with large datasets of data that are for the mostly too large for analysis through regular techniques and scientific procedures. Cases of these expansive datasets incorporate online audits of items and administrations, wellbeing records, and so on. This information can be organized e.g. information from GPS devices or unstructured (e.g. photographs, online networking). When all this is compiled, it comprises of numbers and words that can be effectively analysed, while unstructured information depends more on utilization of watchwords for looking and investigation. The vast development of the Internet over the previous decade or so has driven the solid increment in unstructured information, and as an outcome an expanding number of data analysts and scientists work with unstructured information.

Essential Skills and Training

While prerequisites for work in the Data Science/Data Analytics keep varying with the trend  as indicated by particular organization needs but there are some basic skills that are strictly mandatory in some or other form:

Multivariable Calculus & Linear Algebra

Software Engineering


Data Mining

Machine Learning

Programming Languages such as Python, C/C, Java

Databases such as SQL

Parallel platforms such as Hadoop

For Freshers:

For freshers who want to join this industry it is advisable to go through above concepts/skills and then start with open source projects on platforms such as ‘datacamp’ and ‘kaggle’. For starters learning Hadoop in the event such that you get a few hands on involvement on Java and SQL,it would be useful and simpler for you to proceed with learning of Hadoop. Associations have understood the advantages of Big Data Science as a field now because, it helped them in showing signs of improvement business bits of knowledge, which upgraded their basic leadership capacities. Huge Giants like Yahoo, Facebook, Adobe, LinkedIN, Twitter, and so on are utilizing Hadoop.

The average salary for Hadoop & Java Developer in one of the major tech giants TCS, India is ₹677k – ₹738k, according to a popular source Glassdoor.

What is Big Data?

Big Data is a term utilized for a collection of informational data or results that are substantial and complex, which are hard to store and process utilizing accessible database administration instruments or conventional information handling applications. The test incorporates catching, curating, putting away, looking, sharing, exchanging, examining and representation of this information. Increasing Data information being produced in huge volume, speed and assortment has made it troublesome for the regular database administration frameworks to oversee

You will be surprised to know that maximum i.e. almost “90% of this data is generated in last two years”

This sudden increase in the world’s data has made more than  77% of the companies to accept Big Data as an important and emerging.

Big Data isn’t only a trendy expression any longer. It is critical for associations to focus on it. As per Forbes, it is turning into a development. Information is presently driving more hierarchical choices than any other time in recent memory. With huge measures of information being delivered continuously, there is a tremendous interest for people with aptitudes to study, analyze and enable associations to utilize this information resourcefully.

Future in Big Data

As indicated by the IDC figures, the Data Science sector will be worth at least $46.34 billion by 2018. Big Data technologies and related softwares market is expected to develop at a compound yearly development rate (CAGR) of 23.1% from 2014 to 2019. The yearly spending is anticipated to reach $48.6 billion out of 2019. Hadoop one of the core compounds, has turned out to be relatively synonymous with Big Data, is anticipated to develop at 58.2% CAGR in the vicinity of 2013 and 2020.

Latest blasts in Big Data

Who took what from Facebook?
Amid the mid year of 2014, the U.K. member of U.S. political counseling firm Cambridge Analytica enlisted a Soviet-conceived American specialist, Aleksandr Kogan, to assemble essential profile data of Facebook clients alongside what they loved.” “Around 300,000 Facebook clients, most or every one of whom were paid a little sum, downloaded Kogan’s application, called This Is Your Digital Life, which gave them a progression of studies. Kogan gathered information not simply on those clients but rather on their Facebook companions, if their protection settings allowed it — a universe of people initially estimated to be 50 million strong, then upped to 87 million. The app, in its terms of service, disclosed that it would collect data on users and their friends.

Did Kogan have Facebook’s permission?
In a general sense, yes. Since 2007, Facebook has permitted outside designers to fabricate and offer their own applications inside its space. At the point when Kogan offered his application, Facebook likewise enabled designers to gather data on companions of the individuals who utilized their applications if their protection settings permitted it. “We plainly expressed that the clients were allowing us the privilege to utilize the information in wide degree, including offering and permitting the information,” Kogan wrote in a March 18 email got by Bloomberg.

Then what’s the issue here?
Facebook says Kogan “misled us” by saying he was gathering the information for look into purposes and disregarded the organization’s strategies by passing the information to Cambridge Analytica. Kogan says his application’s terms and conditions particularly permitted “business utilize.” Facebook says that after it scholarly of the circumstance in 2015, it evacuated Kogan’s application and requested that he “and all gatherings he had offered information to” devastate the information.

 Has the data been destroyed?

The New York Times — which broke the story along with The Observer of London — reported on March 18 that emails and documents suggest the firm “still possesses most or all of the trove.” Cambridge Analytica has maintained that it deleted all the data Kogan provided and, at Facebook’s request, “carried out an internal audit to make sure that all the data, all derivatives, and all backups had been deleted.” Facebook’s chief technology officer, Michael Schroepfer, said in an interview on April 5 that pending the results of investigations, “we don’t know exactly what they have.”

Why did Cambridge Analytica want the data?

It uses such data to target voters with hyper-specific appeals, including on Facebook and other online services, that go well beyond traditional messaging based on party affiliation alone. This is known as “psychographic” targeting or modeling.

Did Cambridge Analytica pay Kogan?

It covered his costs in creating his app — more than $800,000 — and allowed him to keep a copy for his own research, the Times reported, citing company emails and financial records.

Who is Cambridge Analytica?

It’s a company that “uses data to change audience behavior,” both commercially and politically, according to its website. Its London-based affiliate, SCL Group, has a history of dubious tricks in elections around the globe. Cambridge Analytica worked in support of the 2016 campaigns of Trump, Ted Cruz and Ben Carson, all Republicans. It was founded in 2013 by former Renaissance Technologies co-CEO Robert Mercer, a major supporter of Trump in 2016; Trump’s campaign manager, Steve Bannon, served on the firm’s board. Days after the first reports about Facebook data, Cambridge Analytica said it had suspended its chief executive officer, Alexander Nix, who caught on camera boasting about the firm’s willingness to use bribes, entrapment with sex workers and other possibly illegal tactics to undermine political candidates.

Join this discussion