Author: Data Science

Our friends at Futurism uses the data from National Academy of Sciences, SmartThings Future Living reports, Scientific American, University of Bristol and several other sources to create this fascinating infographics.

originally posted @ https://futurism.com/images/things-to-come-a-timeline-of-future-technology-infographic/

Source by v1shal

When it comes to business intelligence, most enterprise users are intimately acquainted with tools such as Microsoft Excel. They tend to feel less comfortable with data-management technologies like Hadoop—despite the considerable insights such tools could offer.

Enter AtScale, a startup that on Tuesday emerged from stealth with a new offering designed to designed to put those capabilities within closer reach. The AtScale Intelligence Platform is designed to enable interactive, multidimensional analyses on Hadoop from within standard BI tools such as Microsoft Excel, Tableau Software or QlikView, without the need for any data movement, custom drivers or a separate cluster.

“Today, millions of information workers could derive value from Hadoop, but their organizations have not been able to empower them to do so, either because their current toolset doesn’t work natively with Hadoop or because IT doesn’t have the tools to provision them with secure, self-service access,” said Dave Mariani, AtScale’s founder and CEO.

In essence, AtScale’s platform aims to give business users the ability to analyze in real time the entirety of their Hadoop data—tapping Hadoop SQL engines like Hive, Impala and Spark SQL—using the BI tools they are already familiar with. In that way, its intent is similar in many ways to that of Oracle, which recently unveiled new big-data tools of its own for nonexperts.

AtScale’s software strives to make big-data analytics accessible in several ways. Its cube designer, for instance, converts Hadoop into interactive OLAP cubes with full support for arrays, structs and non-scalars, enabling complex data to be converted into measures and dimensions that anyone can understand and manage, the company says.

“We have a community of more than 110 million users and a massive amount of data about how people play our games,” said Craig Fryar, head of business intelligence at Wargaming, creator of online game World of Tanks. “Our cluster stores billions of events that we can now easily explore in just a few clicks.

Originally posted via “AtScale opens Hadoop’s big-data vaults to nonexpert business users”

Source by analyticsweekpick

Image originally posted on Zengage, The Zendesk Blog

Source by v1shal

NHS taps artificial intelligence to crack cancer detection: The UK’s health service, Intel, and the University of Warwick are collaborating to form a ‘digital repository’ of known tumor cells, which they hope to use to develop new algorithms for classification of those cells.

When Cancer Patients Should Ask For Genetic Sequencing: At Memorial Sloan Kettering Cancer Center, more than 10,000 tumor biopsies from patients with advanced cancer were sequenced. Many of the patients had mutations that could be addressed with current treatments

Intermountain makes strides in precision medicine, advanced imaging: The Utah-based health system has added technology to perform specific and sensitive sequencing of solid tumor cells as well as imaging technology to monitor wounds.

How providers can use analytics to manage risk in value-based care: Two examples are presented: a Maryland hospital and a New York physician’s network.

Source: May 15, 2017 Health and Biotech analytics news roundup by pstein

The Department of the Navy isn’t making as much progress on data center consolidation and moving to the cloud as it wants to. So the Navy is moving the initiatives under a new owner and coming down hard on those who are standing in the way.

“Later this year, we will make an organizational change to our approach to data center consolidation. The Data Center and Application Optimization (DCAO) program office will move from under Space and Naval Warfare Systems Command (SPAWAR) headquarters to under Program Executive Office-Enterprise Information Systems (PEO-EIS) as a separate entity or program office,” said John Zangardi, the Navy’s deputy assistant secretary for command, control, computers, intelligence, information operations and space and acting chief information officer. “This will better align consolidation efforts with network efforts and more fully leverage the Next Generation Enterprise Network (NGEN) contract.

So we will build on their application experience. The DCAO will be responsible for establishing a working model for Navy cloud hosting service brokerage. This will be for the delivery of application hosting via commercial and federal agencies. Culturally, we have to make this shift from a mistaken belief that all our data has to be near us and somewhere where I can do and hug the server, instead of someplace where I don’t know in the cloud. This is a big shift for many within the department. It’s not going to be an easy transition.”

Since 2012, the Navy has made some progress. Zangardi, who spoke at the 14th annual Naval IT Day sponsored by AFCEA’s Northern Virginia chapter, said over the last three years, the Navy has consolidated 290 systems and apps across 45 sites. But overall, he said getting bases and commands to move faster just isn’t happening.

The Navy plans to officially move the data center consolidation office into the PEO-EIS office in July.

Testing the cloud access point

Knowing the difficulties and challenges over the past few years, Zangardi said he’s taking several steps to help ease the pain.

First, he said his office picked three data centers that are lagging behind and required them to develop a plan to consolidate and move their data to a centralized data center.

Second, the Navy is rationalizing large scale apps. Zangardi said too often people hold their applications and servers close.

“I spend a lot of time thinking about the cloud access point (CAP) and our data centers. My objective is to move stuff as quickly as possible. The applications we are looking at right now to move to our cloud access point, the ones I’m most interested in moving right now, would come out of the N4 world, so we are talking about things like maintenance or aviation type of stuff so think logistics,” he said. “We’re also looking at enterprise resource planning (ERP). Can we move our ERP to a cloud type of solution to drive in more efficiencies? I think most of the things we are looking at, at least upfront, would be business sort of applications.”

The third way to ease the pain is by using pilot programs to get commands and bases comfortable with the idea of letting go of their servers and data.

“PEO-EIS and SPAWAR Systems Center Atlantic are piloting a cloud access point in conjunction with the commercial cloud service provider. It’s currently operating under an interim authority to test,” Zangardi said. “These organizations have the right expertise to develop the approach for the department to leverage the cloud. However, the CAP pilot is in its early stages. Essentially right now we are doing table top testing.

Our objective over the next year is to move from a pilot effort to what I would term a productionized commercial cloud. What do I mean by productionized? Simply to me it means an industry leveraged approach that can scale to demand from users. This capability should be secure, provide lower costs for storage and data and facilitate mobility.”

One big question about this consolidation effort is how to break out the 17 or 19 data centers that fall under the NGEN Intranet, and put them under the PEO- EIS team with the other data centers.

Zangardi said the Navy is considering an approach to this, but it’s still in the early stages.

Private cloud works just fine

While the Navy is open to using commercial or public clouds, the Marine Corps is going its own way.

Several Marine Corps IT executives seemed signal that the organization will follow closely to what the Navy is doing, but put their own twist on the initiative.

One often talked about example of this is the Marines decision to not move to the Joint Regional Security Stacks (JRSS) that is part of the Joint Information Environment (JIE) until at least version 2 comes online in 2017. Marine Corps CIO Gen. Kevin Nally said the decision not use the initial versions of JRSS is because Marine Corps’ current security set up is better and cheaper than version 1 or 1.5.

More see – http://www.federalnewsradio.com/412/3857833/Slow-progress-forces-Navy-to-change-strategies-for-cloud-data-centers

Originally Posted at: Slow progress forces Navy to change strategies for cloud, data centers

Beyond the BOOM! How Fireworks Work infographic

 

Originally Posted at: Beyond the BOOM! How Fireworks Work

Increasingly, the CEO’s of all the progressive organizations are focusing on customer experience as a competitive business differentiator. If not already, it should be high on the list of every company aspiring to be successful. Need some convincing? Take a look at the following 25 inspiring and useful customer service quotes as said by CEO’s of company we all admire:

1. “Your most unhappy customers are your greatest source of learning.”- Bill Gates
   This quote resonates well for a growing organization as customers should be the source of all learning and innovation in an enterprise.
2. “It is not the strongest of the species that survives, nor the most intelligent, but the one most responsive to change.” –Charles Darwin
   I love the way how Charles Darwin has simply explained one of the most important concepts in the history of human evolution. This applies very well to business evolution.
3. “Well done is better than well said.” –Benjamin Franklin
   As described in this quote, the importance of successful execution cannot be undermined and understated.
4. “Spend a lot of time talking to customers face to face. You’d be amazed how many companies don’t listen to their customers.” –Ross Perot
   It’s a great quote that addresses a big concern that needs to be fixed by large organizations, if they want to maintain their edge in the future.
5. “If you do build a great experience, customers tell each other about that. Word of mouth is very powerful.”
   -Jeff Bezos, CEO Amazon.com
   Amazon is a pioneer in customer experience and clearly outlines its marketing edge – word of mouth driven by happy customers
6. “The customer experience is the next competitive battleground.” –Jerry Gregoire, CIO, Dell Computers
   Today customer experience is a key differentiating factor for a large number of commodity products.
7. “Quality in a service or product is not what you put into it. It is what the client or customer gets out of it.”
   -Peter Drucker
   Quality of a product needs to be seen and defined from the eyes of the customer. Customer should be able to experience the value and the quality and decide its worthiness.
8. “Customers don’t expect you to be perfect. They do expect you to fix things when they go wrong.” –Donald Porter, V.P. British Airways
   This clearly defined the new customers of the current era. Customers understand that companies are made of people/ humans and want to connect with them and get help when they need it the most.
9. “The more you engage with customers the clearer things become and the easier it is to determine what you should be doing.” –John Russell, President, Harley Davidson
   It is absolutely true that staying close to the customers would always help an organization learn and adapt to compete effectively.
10. “You’ll never have a product or price advantage again. They can be easily duplicated, but a strong customer service culture can’t be copied.” –Jerry Fritz
    We all understand that true strategic advantage is difficult to imitate. Customer service is one of those things that can deliver strong competitive advantage. We all know the examples of Apple, Southwest airlines etc.
11. “In the world of Internet Customer Service, it’s important to remember your competitor is only one mouse click away.” –Doug Warner
    We should remember that we live in a digital era and customers have a lot of choice when it comes to making speedy online decisions. It is inevitable to have a strong online presence for any successful business.
12. “Know what your customers want most and what your company does best. Focus on where those two meet.” –Kevin Stirtz
    This is where the rubber meets the road. It is important for a company to know its strengths and understand its customers to deliver a successful product.
13. “Loyal customers, they don’t just come back, they don’t simply recommend you, they insist that their friends do business with you.” –Chip Bell, Founder Chip Bell Group
    This is the reason why businesses want loyal customers. Apple has done a great job at this.
14. “Customer service is not a department, it’s everyone’s job.” –Anonymous
    Today, customer service is a differentiator for a business and it cannot be left only in the hands of the customer representatives. Everyone in the company should have an ear and an eye for improving customer experience.
15. “When people talk about successful retailers and those that are not so successful, the customer determines at the end of the day who is successful and for what reason.” –Jerry Harvey
    The ultimate power lies in the hands of the customers and they are responsible for making a product/ service successful.
16. “A lot of companies have chosen to downsize, and maybe that was the right thing for them. We chose a different path. Our belief was that if we kept putting great products in front of customers, they would continue to open their wallets.” –Steve Jobs
    Apple is a symbol of customer focused innovation and great customer experience. This is something that competition and businesses should understand and learn from.
17. “You’ve got to look for a gap, where competitors in a market have grown lazy and lost contact with the readers or the viewers.” –Rupert Murdoch
    Competitive research should focus on the customer experience gaps to innovate and differentiate on new and existing products.
18. “Excellent firms don’t believe in excellence – only in constant improvement and constant change.” –Tom Peters
    Change is the true underdog that if done correctly can lead to success and profit.
19. “Every contact we have with a customer influences whether or not they’ll come back. We have to be great every time or we’ll lose them.” –Kevin Stirtz
    This is the new normal for today’s customer. And, this needs to be followed to sustain the customer base.
20. “Here is a simple but powerful rule: always give people more than what they expect to get.” –Nelson Boswell
    This has been widely tested and understood, but difficult to follow and execute. But, if done right, it always pays off.
21. “Statistics suggest that when customers complain, business owners and managers ought to get excited about it. The complaining customer represents a huge opportunity for more business.” –Zig Ziglar
    Data is true and statisticians are helpful. A complaining customer is giving you one more chance to improve before he leaves you and goes to the competitor. So, do listen to him and help him.
22. “Every client you keep, is one less that you need to find.” –Nigel Sanders
    This is the mantra to maintaining your growth and profitability.
23. “If you make customers unhappy in the physical world, they might each tell 6 friends. If you make customers unhappy on the Internet, they can each tell 6,000 friends” –Jeff Bezos
    The new digital world comes with its own benefits and disadvantages and an unhappy digitally savvy customer is the last thing a business wants.
24. “If we keep doing what we’re doing, we’re going to keep getting what we’re getting.” –Stephen Covey
    Great quote to describe the needs for change in this changing world.
25. “We don’t want to push our ideas on to customers, we simply want to make what they want.” –Laura Ashley
    This is another quote that tells the power of the customers and the need to stay close to them to learn, innovate and provide them what they want. This is a win win for everyone.

I loved writing this blog and hope that you enjoy reading it.

Source

PALO ALTO, California — June 18, 2015 — Maana, a pioneer in search engine technology for big-data-fueled solutions, today announced it has successfully built its industry agnostic, end-to-end search and discovery platform on Apache® Spark™. Spark enables Maana to perform massive-scale processing for machine learning and data mining. With Spark, Maana successfully overcomes the limitations of Hadoop’s MapReduce framework, especially with regard to performance and integration.

“Maana is the first and only big data search engine powered by Spark. Switching to Spark was a business decision we didn’t take lightly, and afterwards we never looked back,” said Babur Ozden, founder and CEO of Maana.

Maana runs natively on Spark and uses its in-memory caching, which enables Maana to re-use parts of the computation. The in-memory caching is designed to increase application performance by holding frequently requested data in memory, reducing the need for database queries to get that data.

“Maana has been running on Spark for over a year and a half. For Maana, working with extremely large technical datasets from numerous different sources requires both speed and sophisticated analysis. We weren’t getting the results with Hadoop MapReduce v1. Spark, the industry standard, is easier to use and the best alternative to the more exotic solutions available,” said Donald Thompson, founder and CTO of Maana. “The growing ecosystem around Spark allows our data scientists and our customers to use the languages and tools they are already familiar with.”

About Maana

Maana is pioneering new search technology for big data. It helps corporations drive significant improvements in productivity, efficiency, safety, and security in the operations of their core assets. Investors include: Chevron Technology Ventures, ConocoPhillips Technology Ventures, Frost Data Capital, GE Ventures, and Intel Capital. Maana is privately held with offices in Palo Alto, California and Bellevue, Washington. Visit us at www.maana.io.

To read the original press release on Maana, click here.

Originally Posted at: The First and Only – Big Data Search Engine Powered by Apache® Spark™

Have you ever found yourself in a flux chasing after websites, agents, travel blogs, coupons to find your great travel deal? I am no different and spend good chunk of hours on travel deal hunting. I came across this amazing video by Jason Cochran on WalletPop.com, Jason walks us through easy to follow steps, helping us get to that great travel deal faster. Hope these tips will help you get to your travel-deal faster as well. These are great suggestions, I have been using few of them myself, and they work great.

Let me know if there are any other tips/tricks that you use and are not covered in the video below.

Source: Tips To Hunt For That Great Travel Deal

In the push for more revenue growth, Twitter has been building up its business in areas like advertising and commerce, but a move made late Friday night points to another area where the company is setting its sights: big data analytics.

Twitter announced that it will be terminating agreements with third parties for reselling firehose data — the unfiltered, full stream of Tweets and all related metadata that goes along with them.

Instead, it will use its own in-house big data analytics team, which it developed around its acquisition of Gnip in 2014, to seek to build direct relationships with the data companies, brands and others that use Twitter data to measure consumer sentiment, market trends and other moving targets that can be better understood by tracking online conversations — a transition it says it hopes to have completed by mid-August.

DataSift, the biggest company to be affected by Twitter’s move, services thousands of businesses who in turn serve thousands more. Unsurprisingly it moved quickly to post its own reaction to the termination and its own determination to push ahead in its own business.

NTT Data, which deals only in Japanese Tweets, is still listed as a Twitter firehose partner at the time of writing, but Twitter has confirmed to me that NTT is also affected by Friday’s announcement.

This is both a very unsurprising and sudden move, from the looks of it.

Talking to Nick Halstead, the CEO and founder of DataSift, he said that his company was “blindsided” by Twitter’s announcement, which it made without any warning to DataSift. He said that before this, the pair had been discussing a renewal of the deal. And while DataSift recently added Facebook — Twitter’s big social advertising competitor — as a firehose partner, it didn’t appear that this would impact those discussions.

“We were in the middle of negotiations with everything pointing to Twitter wanting to still continue to be a part of an open ecosystem,” he said, “but this is clearly now not true.”

On the other hand, for those who have been following how Twitter has grown as a business, the company’s move to cut off third-party firehose relationships should come as no surprise.

The company has made no secret of its bigger philosophy about how it interfaces with third parties in general. In its (in)famous ‘quadrant’ diagram, the company outlined its position towards third parties that added value to what Twitter was doing versus those that effectively overlapped with Twitter’s own efforts: those who were building Twitter clients that “mimic” Twitter’s own experience in reproducing the Twitter stream were getting cut off.

You can think of last year’s move by Twitter to acquire Gnip — another firehose reseller who competed with DataSift — as a step Twitter was taking to move its interests into one more area of that quadrant.

At the time the acquisition was seen mainly as a response to Apple’s acquisition of Topsy, who had been another firehose partner. And DataSift went so far as to reassure people that its status with Twitter would not be affected. But now it’s clear that Twitter had other things in mind, too.

Zach Hofter-Shall, head of Twitter ecosystem, said as much in his blog post late Friday:

In fact, whether they wanted to believe it or not, these companies were told by Twitter that they would be getting cut off nearly a year ago, we understand.

The direct relationships Twitter has with data customers, meanwhile, are also starting to take a new kind of form. Just last month, Twitter made its first investment in a startup through its new investment vehicle. The recipient? Dataminr, one of the companies that analyses Twitter firehose data, in its case to track news and financial data.

The reason why Twitter wants to tap into more big data business, of course, comes down to one big reason: money.

Since going public, Twitter has regularly faced questions about user growth. On one hand, that has led it to many iterations as it tries to snag more consumers who are not already regular Twitter users. On the other, it has increasingly focused on ways that it can better monetise what it already has.

That’s where the big-data services come in. Twitter’s data firehose, from what we understand, makes up a relatively small portion of DataSift’s revenues. The company makes 20% of its revenues from licensing data, with that data including Twitter but also more than 20 other networks. The remaining 80% comes from data processing.* Cutting off the firehose to DataSift, Twitter hopes, will potentially give it access to (and better returns on) the customer deals that DataSift held before.

(The big question now will be whether Twitter manages to convince enough of the people who used to buy data through DataSift to turn directly to Twitter for those needs instead.)

“Twitter believes that creating a closed market for their data allows them to generate more revenue,” Halstead told TechCrunch. “We believe and others believe that an open ecosystem is important for a brand to understand what is going on in the market.”

As for where DataSift is turning next, the company says it is signing on more social networks to provide its own firehose data feeds. No comment from DataSift on which feed will be next, but it’s notable LinkedIn is not yet a partner. The social network for the working world is clearly looking for more ways of using its data for analytics, and this seems an obvious route to do that.

DataSift is also still able to work with Twitter data: if a third party buys data from Twitter, it can supply it to DataSift by way of a “connector” so that it can still be parsed by DataSift’s algorithms. However, this will mean significantly lower revenues for DataSift in the process from that feed. And  armed with its Facebook deal and other developments in the pipeline, DataSift is pressing ahead with business. The company is currently in the process of raising a new round of funding — a Series D round. To date, DataSift has raised nearly $78 million.

Update: Mark Suster writes that DataSift returns 95% of data revenue back to Twitter. The 20/80 ratio we were describing referred to revenues from data firehose licensing versus data processing revenues for DataSift. We’ve updated the passage above to clarify this.

Originally posted via “Twitter Cuts Off DataSift To Step Up Its Own Big Data Business”

Originally Posted at: Twitter Cuts Off DataSift To Step Up Its Own Big Data Business by analyticsweekpick