Tag Archives: weather

The rise of big data in science

Image: Shutterstock

Our growing ability to combine, share and make sense of large and complex datasets is opening the door to huge new opportunities for Australia and the world. Big data is powering climate and weather models, and leading to more sustainable farming with improved yields.

These two examples are just a tantalising glimpse of the possibilities. There are still plenty more big data applications to discover. At the same time, mathematicians are working hard to reduce the energy use of this power hungry beast.

Messy weather

Associate Professor Savin Chand. Credit: Supplied.

In March, Tropical Cyclone Alfred threatened the coast of Brisbane. Thanks to data and modelling, weather forecasts provided Brisbanites with plenty of time to sandbag their homes and prepare for the huge amount of rainfall.

“Continued development in these modelling systems, through innovative approaches, can lead to more accurate predictions of weather systems such as Tropical Cyclone Alfred beyond one week [in advance],” says Savin Chand, an associate professor of applied mathematics and statistics at Federation University.

Weather data is particularly difficult because it doesn’t come neatly in one form. Modelling relies on data from different sources and types, including temperature, pressure, windspeed and rainfall. Our ability to combine heterogeneous data types and sources remains one of the most pressing challenges of big data.

From data predictions to dinner plate

Weather data is also vital to farming and agriculture, where it combines with datasets from genomic analysis, soil and sensor readings, satellite imagery, biosecurity markers, animal trackers and even market trends.

But generating all this data is just the beginning, says Professor Neena Mitter, biotechnologist and deputy vice chancellor associate of global research at Charles Sturt University.

“The real power is in how data can be integrated to make smarter decisions,” Mitter says. “How do we apply this data for solving real world problems?”

Bioinformatics is the discipline at the interface between biology and computer science. Mitter says bioinformatics is already unlocking huge possibilities for food security and sustainability.

“We once had to rely on long breeding cycles and field trials. We can now use genetic data to predict which plants or animals are more likely to thrive in certain conditions, long before they reach the paddock or the farm.”

Professor Neena Mitter, biotechnologist and deputy vice chancellor associate of global research at Charles Sturt University. Credit: Supplied.

A growing energy challenge

Professor Jacqui Ramagge. Credit: Supplied.

Thousands of data centres across the world churn through energy – perhaps 1% of the world’s total – and data is only going to become more important. But mathematics is finding a way to cut back on this energy consumption.

Professor Jacqui Ramagge, executive dean of science, technology, engineering and mathematics at the University of South Australia, and incoming ACDS president, says such a vast amount of energy is used because many computations are done by “brute force”.

Ramagge uses the analogy of a curved line graph. “Suppose you want to know where the line crosses the x-axis, where y is equal to 0”. Computers will find it by looking at every point along the x-axis and evaluating whether y is zero. A human would be far more efficient: they would use a quadratic equation.

In an effort to cut computing energy use, mathematicians are working with computer scientists to develop formulae to help computers find solutions more efficiently. Like using a quadratic equation, only far more sophisticated.

As we increasingly turn to modelling and computation to help us solve global challenges, reduced energy use from computing centres will cut down on electricity bills and also reduce the climate impacts of big data.

Written by Sara Phillips and Cristy Burne

First published in Australian University Science, Issue 13

Big data, big business

Featured image above: Plume Labs use pigeons to monitor air quality in London. Credit: Plume Labs

Optimising highway networks, mapping crime hotspots and producing virtual reality sporting experiences based on real-life games: these are just a few of the exciting outcomes that new businesses are now achieving with complex data analysis. More and more startups are using readily available data to create products and services that are game changers for their industries.

Big data, for example, is what lies behind Uber’s huge success as a taxi alternative; the company optimises processes by using data analysis to predict peak times, journey time and likely destinations of passengers. Many other companies are now using data to produce technology-based solutions for a range of issues and even designing new ways to collect data.

A weather station and umbrella all in one

Wezzoo, a Paris-based start-up company, has designed a smart umbrella that tells users when it’s going to rain. The ‘oombrella’, as it’s been dubbed, is strikingly iridescent, sturdy in design, and presents a data-based solution to staying dry. It will send a notification to a smart phone 15 minutes before predicted rain and also send a reminder when it’s been left behind on a rainy day.

The oombrella itself is also a mobile weather station, able to detect temperature, atmospheric pressure, light and humidity. “Each oombrella will collect data and share it with the community to make hyperlocal weather data more accurate,” says the company.

Real-time meteorological information from each oombrella is uploaded to Wezzoo’s existing social weather service app. More than 200,000 people already use the app and upload their own weather reports from all over the world, creating a more interactive and collaborative approach to weather observation. This data, as well as information from weather stations is used to create personalised predictions for oombrella users.

‘Pigeon Air Patrol’ monitors pollution

Plume Labs, in collaboration with DigitasLBi and Twitter UK, have literally taken to the skies with their latest air pollution monitoring project, Pigeon Air Patrol. They recently strapped lightweight air-quality sensors to the backs of 10 London-based pigeons to gather data on pollution in the city’s skies. For the duration of the project, the public could tweet their location to @PigeonAir and receive a live update on levels of nitrogen dioxide and ozone, the main harmful gases in urban areas. Not only did this innovative project help collect data in new ways, it raised awareness of air pollution in large cities.

“Air pollution is a massive environmental health issue, killing nearly 10,000 people every year in London alone,” says Romain Lacombe, Plume Labs’ CEO.

“Air pollution is an invisible enemy, but we can fight back: actionable information helps limit our exposure, improve our health and well-being, and make our cities breathable.”

Plume’s core focus is tracking and forecasting ambient pollution levels to allow city dwellers to minimise harmful exposure to polluted air. Their free phone app – the Plume Air Report – uses data from environmental monitoring agencies and public authorities to provide individuals with real-time information on air pollution safety levels at their locations. With the use of environmental Artificial Intelligence, the app predicts air pollutant levels for 300 cities and 40 countries with double the accuracy of traditional forecasting methods. “Predictive technologies will help us take back control of our environment,” Lacombe says.

The company, whilst still small, has managed to raise seed funding from French banks. It plans to build a business based on aggregating data, though is also open to developing hardware.

Innovative data collection methods are not only good for science, it seems; they can also be a strong foundation for business.

This article was first published by the Australian National Data Service on 24 May 2016. Read the original article here.