-->
Showing posts with label Big Data Analysis. Show all posts
Showing posts with label Big Data Analysis. Show all posts

Recharging the energy industry with smart grids, big data and IoT- Martyn Williams

Recent years have seen a new wave of technology and opportunities hit the energy sector, several of which have been presented by the onset of big data and Internet of Things technology.
Ensuring that supply meets the customers’ demand is a key responsibility of the energy industry, however, these smart technologies are changing the way the grid generates, manages, distributes and stores energy.

Smart grids integrate intelligent controls, telecommunications, industrial automation, SCADA software and new technologies with the legacy equipment of existing infrastructure. New technologies enable the electrical grid to instantly respond to our changing energy demands, creating a more efficient transmission of electricity.  

Other benefits associated with the smart grid include quicker restoration after power failures, improved security, remote engineering capabilities, lower electricity rates for consumers and crucially, better integration and easy expansion of new and existing renewable energy systems.   
Historically, the traditional electrical grid has had difficulty accommodating alternative sources of power, however, as renewable energy sources, such as wind and solar, are supplying an increasing percentage of the nation’s power, simplifying renewable integration to the grid is essential.

Fossil-fuel power plants operate at a pre-mitigated output level, meaning they provide a consistent and predictable amount of electricity. However, some forms of renewable power are reliant on a fluctuating resource. In the cases of wind or solar power, for example, if the wind speed slows or clouds obscure sunlight from solar panels, the energy output will drop without warning. Smart technology is able to predict when this might happen and automatically identify and execute an alternative energy source to make up for a potential decrease in energy supply.

Much of the discussion surrounding smart grids and renewables is still at the conceptual or proof-of-concept stage, and, as a result, it can be difficult to translate these technologies into real, tangible strategies for the existing electrical system. However, there are a few technologies that are already leading the way in the smart grid race.

IoT fuelled distribution

In October 2016, Reactive Technologies used smart technology to transmit data across the national energy grid for the first time in history. The new system inserts data as small changes into the 50Hz signal itself, which jumps the air gap that previously prevented the transmission from taking place.
This technology is capable of sending messages through electricity cables to appliances such as heaters, fridges and kettles that use a smart plug. This tells appliances to make small variations in their energy usage, marginally reducing the overall consumption of thousands of homes and businesses.

While this small change may be unnoticeable to homeowners, it could make a significant impact to the nation’s carbon footprint. Smart technologies, like this new data system, are reducing the likelihood of utility companies turning to nuclear power stations or diesel generator farms during peak hours of energy consumption. It also makes brownouts less likely and, subsequently, lowers the nation’s carbon emissions.

This way, when the nation simultaneously reaches for their kettles to sooth their morning caffeine craving, we are not burning gallons of diesel in the process.    

Information is power

The introduction of smart technology and intelligent infrastructure has not only transformed the way energy suppliers can, and will, manage energy and carbon emissions, but also continuously delivers consumption and efficiency data directly to the suppliers themselves.
The true value of big data resembles that of crude oil. While it may be hugely valuable, it is useless when unrefined. According to a recent statement by Gartner, the adoption of big data analytics is one of the key trends in the energy sector, especially for organisations hoping to reduce costs and enhance their competitive advantage. While there are a number of reasons energy companies should archive data, predictive analytics has, by far, the most potential.

By integrating intelligent SCADA software, energy suppliers can automatically collect and archive data on-site or in the cloud. This way, engineers can remotely analyse the real-time and historical data of any substation in the network by storing these records in a centralised cloud location. Naturally, this data is only as valuable as the tools used to analyse it. When choosing a SCADA application, it is vital that energy companies look for software that can deliver business intelligence from data.
Naturally, the ability to monitor operations remotely is a huge benefit for the energy industry, particularly for sectors dealing with isolated sites such as electrical and offshore oil and gas. However, this enhanced connectivity does raise concerns regarding cyber security.

Security by design

We have all heard of the heightened security threats surrounding smart technology and the energy industry is no exception. In a worst-case scenario, the risk of security breaches to smart energy grids has the potential to plunge entire parts of the country into darkness.

When choosing a HMI/SCADA platform, energy companies should opt for software with multiple cyber security barriers to protect against attackers. At COPA-DATA, the topic of cyber security has been an integral part of product design from its inception. The zenon product family, for example, is HMI/SCADA software for energy and infrastructure developed with security in mind. These security methods include providing encryption of network traffic, client authentication and creating ‘islands’ in a distributed network.

As a systems integrator, Capula operates across the entire energy sector and has recently developed its next generation of substation control systems, utilising zenon’s inbuilt security.
While integrating the right SCADA software is paramount, energy companies cannot just rely on software to protect the grid. For complete security, cooperation is key. Energy companies should provide conventional employee training and undertake targeted security tests against energy systems. COPA-DATA works alongside partners at TÜV SÜD and public institutions such as the United States Computer Emergency Readiness Team (US-CERT).

Despite ongoing technical development and enhanced protection against cyberattacks, it is important that energy companies do not lose sight of the physical security threats at these isolated locations. Electrical substations, for example, are intentionally designed to appear discrete, to avoid attracting the attention of any criminals who may want to destroy or tamper with the electrical supply. However, the unobtrusive appearance of these substations usually means that there are no security lights, CCTV deterrents or significant fencing or barricades – requiring even more care when choosing cyber security methods.

The future energy mix

The energy sector has dramatically transformed over the past few decades and we are likely to see even more drastic changes in the near future. As technology continues to develop, the way that the industry generates, manages, distributes and stores energy will develop too.

Recently, ambitious proposals to harness the energy of the Atlantic’s tidal surges have been forwarded to the government for a review of tidal lagoon technology. The £1.3 billion project consists of a prototype system of dams and turbines, which will be built on Swansea Bay before being rolled out in full. Unlike other forms of power generation, tidal power is not subject to the irregularities of weather, meaning that utilities companies can guarantee when every high tide will be for years into the future. The project – along with many other similar innovations in the pipeline - could transform the UK’s power supply by providing Britain with a zero-carbon source of energy.

The energy industry has come a long way since the fossil-fuel burning days of the industrial revolution. In fact, the transformation of the sector is unrecognisable in comparison to just a few decades ago. New technologies such as big data analytics and smart grids, combined with a growing demand for renewable energy sources are likely to change the industry even more dramatically.

Capitalize On Social Media With Big Data Analytics

Social media promises to accelerate innovation, drive cost savings and strengthen brands through mass collaboration. Companies across every industry are using it to hype new products and services, and also monitor what people are saying about their brand. And yet, most struggle to measure the true value of social media engagement and few have the big data analytic capabilities in place to deliver insights on how these activities impact the bottom line.

How Big Data And The Internet Of Things Improve Public Transport In London

Transport for London (TfL) oversees a network of buses, trains, taxis, roads, cycle paths, footpaths and even ferries which are used by millions every day. Running these vast networks. so integral to so many people’s lives in one of the world’s busiest cities, gives TfL access to huge amounts of data. This is collected through ticketing systems as well as sensors attached to vehicles and traffic signals, surveys and focus groups, and of course social media.

Software AG Identifies a Big Data Paralysis

Software AG (Frankfurt TecDAX: SOW) announced the results of a global survey showing that while decision makers understand that greater visibility over internal processes and real-time data analysis could lead to operational improvements, they still lack the support and solutions needed to make it a reality. Vanson Bourne, commissioned by Software AG, surveyed 750 global respondents whose organizations have in excess of 500 million dollars in annual revenue.

With the recent explosion of data, especially as the Internet of Things (IoT) has emerged as an IT trend sweeping across the business world, 73 percent of organizations are finding analyzing this increase in data a major challenge.

Roundup Of Analytics, Big Data & Business Intelligence Forecasts And Market Estimates, 2015

Salesforce (NYSE:CRM) estimates adding analytics and Business Intelligence (BI) applications will increase their Total Addressable Market (TAM) by $13B in FY2014.
89% of business leaders believe Big Data will revolutionize business operations in the same way the Internet did.

83% have pursued Big Data projects in order to seize a competitive edge.

Despite the varying methodologies used in the studies mentioned in this roundup, many share a common set of conclusions. The high priority of gaining greater insights into customers and their needs, more precise information on how to best simplify sales cycles, and streamline customer service are common. The most successful Big Data uses cases illustrate how enterprises are getting beyond the constraints that hold them back from being more attentive and responsive to customers.
Presented below is a roundup of recent forecasts and estimates:

Archived But Accessible: Retirement Planning For Your Big Data

There is a special time in the life of every piece of data when it is in its prime and at its most active. Some data might be at its peak for 20 seconds while other data might be important for a year or more.

Alas, time and changing context inevitably catches up with all data. So what are your plans for what comes next for your data? Here are some things to consider when planning what will happen to data that’s reached its golden years.

Big data is no longer hype, CSPs are embracing analytics

Big data analytics has been a frequent topic in several discussions about trends in the telecommunications business. While vendors make an effort to sell their latest solutions, carriers haven’t spent much energy on making it happen.

“Big data has been hype for many years, but now it’s definitely a reality,” said Matt Roberts, director at Amdocs, in a video interview with RCR Wireless News, during Amdocs’ LatAm Business Summit, held in Cancun.

Without Good Analysis, Big Data Is Just a Big Trash Dump - Vin Gupta

Big Data, Mega Data or Meta Data are the buzzwords in corporate lingo. It is like a bunch of high school boys bragging in the locker room. But “Big Data” can be a “big pile of trash,” unless mined by geniuses. This whole new phenomenon seems like nothing but job security for data nerds who want to protect their huge budgets.

IBM and Deloitte bring big data to risk management

IBM and Deloitte are betting that computers can understand reams of financial regulatory guidelines more thoroughly, and speedily, than humans.

The two companies have developed a system that can parse complex government regulations related to financial matters, and compare them to a company's own plans for meeting those requirements.

When Big Data Becomes Your Most Valuable Asset

Caesars Entertainment, formerly known as Harrah’s – the company which runs the famous Caesar’s Palace Las Vegas and more than 50 other casinos worldwide – established itself as an early leader in Big Data customer service. It has hit more than a spot of bother recently with a messy bankruptcy of its casino operating unit and reportedly facing fines of up to $20 million over money laundering allegations.

Big data analyzed right means big payoffs

By Eric Haller
People are making a big deal about big data—and it is a big deal. It has the power to guide us in addressing some of our nation’s most pressing needs, from protecting against fraud at the checkout counter to helping families secure affordable loans that help them accomplish their dreams. And like any powerful tool, it must be deployed wisely; in the wrong hands, as Hollywood saw recently, data can be hacked.

ADP Launches Its Own Big Data Analytics Platform

ADP DataCloud is designed to put day-to-day analytics capabilities in the hands of line-of-business accounting and HR staff members.

Automatic Data Processing -- better known as ADP, the payroll service to much of the world -- went into the big data platform business on May 12.  And why not, with more than 600,000 client business and 24 million employees in the U.S. alone from which to access piles of metadata.

Big Data insights is like shooting fish in a barrel

Big Data as a concept has the potential to provide so many useful insights into our daily lives and business processes, but often organizations can get caught up in the hype.
Having access to tons and tons of data is not the only step to coming up with useful insights, but organizations can use it effectively if they know how. It has been estimated that for every day in 2012, 2.5 Exabytes of data were created -- today th

SAP denies Salesforce rumours, British Gas big data use, Office 2016 preview

It's been a busy week as three major firms hosted annual conferences in the US. V3 reported live from each event, and readers were clearly keen to hear what the companies had to say.

SAP's Sapphire event took place in Orlando, and the firm used the show to unveil new products, such as HANA Cloud Platform IoT, and to dismiss rumours that it is in the running to buy Salesforce.

CEO Bill McDermott said that the firm has "zero interest" in Salesforce, which leaves Microsoft as the most likely buyer, although nothing is certain at this stage.

Meanwhile, EMC World was taking place in Las Vegas, where the firm showed off its Data Domain DD9500 product that aims to remove cloud data and storage fears by offering a super-fast and scalable deduplication disk backup appliance.

Finally, NetSuite's SuiteWorld event took place in San Jose, where V3 reported that the firm has ditched AWS for hosting its services and instead cosied up with Microsoft. NetSuite also confirmed that an EU data centre offering is on its way.

The Best Big Data And Business Analytics Companies To Work For In 2015

InsightSquared, Paxata, Trifacta, Cloudera, Birst, Sumo Logic, Gainsight, Google, Ayasdi and Visier are the most recommended big data and business analytics companies by employees to friends.

These and other insights are from an analysis completed today comparing Glassdoor ratings by the companies listed in the latest Computer Reseller News Big Data 100.  CRN published the Big Data 100, a compilation of the top Big Data Infrastructure, Tools and Services, Business Analytics, Data Management, and Emerging Big Data Vendors earlier this week.  The CRN lists were used to keep the analysis and rankings fair and impartial.

Using the 2015 Big Data 100 list as a baseline to compare the Glassdoor scores of the (%) of employees who would recommend this company to a friend and (%) of employees who approve of the CEO, the following series of tables were constructed. You can find the original data set here and a PDF of the results here. There are many companies listed on the CRN list that don’t have than many or any entries on Glassdoor and they were excluded from the rankings below.

I'm with the Band: Microsoft talks fitness, big data, and security at ThinkNext

Collecting data is one thing, using it right is something else: Microsoft's out to showcase how to turn data into information at its shindig this week in Israel.
 
Yoram Yaakovi presents 'People Like You' at ThinkNext 2015 in Tel Aviv. Image: Microsoft

There's quite a bit of data out there, and there's a lot more on the way - and it finally appears, says Yoram Yaakovi, CEO of Microsoft Israel's R&D Center, that the IT industry is figuring out what to do with it.

Small Businesses Shouldn't Fear Big Data

There is an insane amount of data out there.

Finding ways to use that data can seem intimidating, especially to an entrepreneur who is working 80 hours a week just to keep a new business on track. But I’d like to make the case that most entrepreneurs should be trying to incorporate big data into their businesses from the very beginning.

According to IDC, by 2020 there will be 44 trillion gigabytes of information out there; about ten times the amount of data there is today. Soon we’ll be measuring data by zettabytes — 1 sextillion bytes.

Big data for small businesses

Big data might seem like it's something that only big business can make use of. When people first hear that massive volumes of information are being used to fight terrorism, cure cancer or predict the spread of Ebola,

Rocana Lands $15M To Bring Big Data Analysis To IT Ops

Rocana (formerly ScalingData) announced $15 million in Series B funding led by Google Ventures with General Catalyst Partners, Toba Capital and Paul Sagan (former chairman at Akamai and current executive in residence at General Catalyst) also contributing.

This round brings the total raised to $19.4 million.

Microsoft to offer three new ways to store big data on Azure

Microsoft will soon offer three additional ways for enterprises to store data on Azure, making the cloud computing platform more supportive of big data analysis.