APAC CIO Outlook
  • Home
  • CXO Insights
  • CIO Views
  • Vendors
  • News
  • Conferences
  • Whitepapers
  • Newsletter
  • Awards
Apac
  • Agile

    Artificial Intelligence

    Aviation

    Bi and Analytics

    Big Data

    Blockchain

    Cloud

    Cyber Security

    Digital Infrastructure

    Digital Marketing

    Digital Transformation

    Digital Twin

    Drone

    Internet of Things

    Low Code No Code

    Networking

    Remote Work

    Singapore Startups

    Smart City

    Software Testing

    Startup

  • E-Commerce

    Education

    FinTech

    Healthcare

    Manufacturing

    Retail

    Travel and Hospitality

  • Dell

    Microsoft

    Salesforce

    SAP

  • Cognitive

    Compliance

    Contact Center

    Corporate Finance

    Data Center

    Data Integration

    Digital Asset Management

    Gamification

    HR Technology

    IT Service Management

    Managed Services

    Procurement

    RegTech

    Travel Retail

Menu
    • PropTech
    • Microsoft
    • Procurement
    • Managed Services
    • Cyber Security
    • Gamification
    • Blockchain
    • CRM
    • Software Testing
    • E-Commerce
    • Low Code No Code
    • MORE
    #

    Apac CIO Outlook Weekly Brief

    ×

    Be first to read the latest tech news, Industry Leader's Insights, and CIO interviews of medium and large enterprises exclusively from Apac CIO Outlook

    Subscribe

    loading

    THANK YOU FOR SUBSCRIBING

    • Home
    • PropTech
    Editor's Pick (1 - 4 of 8)
    left
    IP - Powering the Future

    Robert Bollard, CIO and General Manager Innovation & Technology Group, IP Australia

    Proptech: Why It's All About the Customer

    Mark Hansen, Chief Information Officer, DEXUS [ASX: DXS]

    The Rise Of Data in The Infrastructure Sector

    Dan Kieny, SVP/CIO, Black & Veatch

    Know Your Rights Before Buying a Residential Unit in a Mixed-use Project

    Florian Maier, Managing Director, Antares Group

    Emerging Technologies Are Turning Proptech Upside Down and Inside Out

    Stan Fung, Managing Director, Drum Tower Ventures

    Australian Property: The Exception or The Rule?

    Paul Gambles, Managing Partner, MBMG Group

    PropTech's Growing Impact on Real-Estate

    Linda Rudd, Partner and Head of Asset Management Services, Knight Frank Australia

    Trends in Design and Construction

    Patrick Keane, Director, Enter Projects

    right

    Big Data Analytics

    Dr Li Xiaoli, Head of Data Analytics Department, Institute for Infocomm Research (I2R), A*Star

    Tweet
    content-image

    Dr Li Xiaoli, Head of Data Analytics Department, Institute for Infocomm Research (I2R), A*Star

    Big data analytics has become critical in recent years with the increasing data that is collected from various application domains. Enterprises and Business owners want to analyse these large volume of data to extract knowledge and insights that could potentially be used to improve their productivity and profitability, and also to assist business decisions making.

    For example, in the manufacturing domain, various sensors (e.g. vibration sensors, acoustic sensors, temperature sensors) have been deployed to collect huge amount of time-series sensory data to monitor manufacturing equipment on their performance, predicting potential failures and the remaining useful life, as well as forecasting product yield in complex manufacturing processes.

    Clearly, there are many technical challenges in big data analytics that need to be addressed before we can reap great benefits. We will elaborate some generic and specific challenges separately.

    Generic challenges for big data analytics

    1) Scalability issue: the volume or sheer size of the data that is larger than the capacity of current computer. We will need to deploy scalable big data analytics platforms (with the help of distributed systems) to handle such issue.

    2) Complexity issue: we may need to handle variety or different types of data, including structured data or unstructured data, while many analytics techniques are designed for structured data only. In other words, for certain applications, heterogeneous data, including transaction data, free text data, image and video data, social network data etc, need to be integrated and processed effectively. Often, data integration is a very powerful tool for many applications, i.e. link and merge data from multiple sources, as it could provide comprehensive overview or full picture of actual application scenario. In addition, it could simply provide more rich useful data to be leveraged for various applications.

    3) Velocity issue: data are not static but rather dynamically change over time. We will need to design new algorithms so that we can quickly crunch or process data to provide prompt response and rapid model update with new incoming data.

    4) Privacy issue: In healthcare application, electronic health records from different hospitals/clinics can be merged to build diagnostic models for certain disease investigation.

    Typically Rich Relevant Data Can Potentially Lead To More Useful Insights Or Accurate Prediction Models

    It is also interesting to understand users’ travel patterns based on integrating traffic data, CDR data, and Wi-Fi data for various transportation and smart nation applications. However, at the same time, people now have serious concerns on the privacy issue of their personal health data, trajectory or location data. How to perform privacy preserving data analytics needs more research.

    Specific challenges for big data analytics

    1) Handle imbalance data applications: In several application domains, such as fraud detection in financial data analytics, machine or aircraft component failure diagnosis and prognostic in manufacturing and aerospace, disease diagnosis in healthcare, earthquake prediction, intrusion detection in network forensics etc, there is an imbalanced data issue that needs more attention. For example, most of the data represent normal class (i.e. non-fraud, non-disease or negative class) and few examples are available to train a model to recognize abnormal class conditions (i.e. fraud, disease or positive class). Here, normal class examples far exceed abnormal class examples. In other words, fraud, diseases and abnormal data are often rare, compared with normal cases, which leads to highly imbalanced data for learning. In fact, here we have big data for normal class but small data for abnormal class, and big data cases are better represented in data than minority or small class cases. Clearly, how to accurately predict the abnormal cases (e.g. fraud cases) is very important. However, analytics models that are designed to optimize prediction accuracy for the above applications will be biased and will make wrong predictions as it likely classifies unknown cases into majority or normal class (we thus cannot effectively detect fraud, disease, faults or failures).As such, the techniques that can effectively handle imbalanced data are urgently needed. While there are few research work aim to balance data by generating artificial minority class examples (by performing oversampling), this problem is far from sufficiently addressed and we need more research to tackle this challenging issue.

    2) Edge analytics and cloud computing: In manufacturing, aerospace& healthcare environment, big data (typically from sensors or other devices) are typically collected and traditional centralized data analytics mechanism (using cloud computing) is not suitable for such environment for these time-critical applications. However, edge analytics is very appealing and attractive, as it can perform analytical computation at a sensor, network switch or other device level, instead of waiting for the data to be sent back to a centralized data server or cloud. In other words, edge analytics pushes data analytics to edge devices where data are generated, so that heavy data communication and transmission cost can be largely reduced, and thus big data analytics can be conducted more promptly and even in real time. As such, recently, edge analytics has become very popular (e.g. in industry 4.0 applications) due to its clear technical and practical advantages and benefits. Nevertheless, we will need design analytics techniques that can be performed in resource constrain computational environment (with less computing power, small memory, less electricity supply) to achieve efficient but relatively accurate results. On the other hand, if we can find ‘interesting’ data using edge analytics, we can also send these small amounts of data to cloud to conduct more detailed and advanced data analytics, i.e. edge and cloud collaboration mechanism for sensor big data analytics.

    Overall, there are many challenging issues and plenty of opportunities for big data analytics. Typically rich relevant data can potentially lead to more useful insights or accurate prediction models. When we really have huge amount of big data for model building, either classification models or regression models, we can also perform intelligent pre-processing to turn big data into small data keeping those important data points only to achieve fairly accurate prediction results.
    tag

    Big Data

    Sensor

    Aerospace

    Cloud Computing

    Industry 4.0

    Data communication

    Financial

    Weekly Brief

    loading
    Top 10 Proptech Solution Companies - 2020

    Featured Vendors

    ZWEISPACE Japan

    Hayato Kameta, CEO

    AES Technologies

    Henry Tan, Founder

    ON THE DECK

    PropTech 2020

    Top Vendors

    PropTech 2019

    Top Vendors

    Previous Next

    I agree We use cookies on this website to enhance your user experience. By clicking any link on this page you are giving your consent for us to set cookies. More info

    Read Also

    A dose of our own medicine

    A dose of our own medicine

    SABINA JANSTROM, IT DIRECTOR, DYNO NOBEL
    Insider Threat

    Insider Threat

    AI is America's best weapon for disrupting health inequities

    AI is America's best weapon for disrupting health inequities

    Michael Dowling, President & Ceo, Northwell Health and Tom Manning, Chairman, Ascertain
    Combating IoT Challenges with Smart Choices

    Combating IoT Challenges with Smart Choices

    Sandeep Babbar, Head Of Technology Innovation, Gwa Group Limited
    Artificial Intelligence regulations and its impact on medical devices

    Artificial Intelligence regulations and its impact on medical devices

    Leo Hovestadt, Director Quality Assurance Elekta
    Blockchain: promises to revolutionise superapps and the trust factor in insurance

    Blockchain: promises to revolutionise superapps and the trust factor in insurance

    Sue Coulter, Head of Group Digital, AIA Group Julian Lo, Director of Digital Engineering, AIA Group
    Data as a Business

    Data as a Business

    Ricardo Leite Raposo, Director of Data & Analytics at B3
    How Digital Transformation Impacts Big Data Analytics

    How Digital Transformation Impacts Big Data Analytics

    Davide Di Blasi, Global Quality and Lean Director , Hilding Anders International
    Loading...

    Copyright © 2023 APAC CIOoutlook. All rights reserved. Registration on or use of this site constitutes acceptance of our Terms of Use and Privacy and Anti Spam Policy 

    |  Sitemap |  Subscribe |   About us

    follow on linkedinfollow on twitter follow on rss
    This content is copyright protected

    However, if you would like to share the information in this article, you may use the link below:

    https://proptech.apacciooutlook.com/cxoinsights/big-data-analytics-nwid-4524.html