Saved searches

Use saved searches to filter your results more quickly

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

oneAPI Data Analytics Library (oneDAL)

License

Notifications You must be signed in to change notification settings

oneapi-src/oneDAL

This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Folders and files

Latest commit

History

Repository files navigation

oneAPI Data Analytics Library

Installation | Documentation | Support | Examples | How to Contribute oneAPI Data Analytics Library (oneDAL) is a powerful machine learning library that helps you accelerate big data analysis at all stages: preprocessing, transformation, analysis, modeling, validation, and decision making. The library implements classical machine learning algorithms. The boost in their performance is achieved by leveraging the capabilities of Intel® hardware. The oneDAL is part of the UXL Foundation and is an implementation of the oneAPI specification for oneDAL component.

Usage

• Use oneDAL C++ interfaces with or without SYCL support (learn more)
• Use Intel(R) Extension for Scikit-learn* to accelerate existing scikit-learn code without changing it
• Use daal4py, a standalone package with Python API for oneDAL Deprecation Notice: The Java interfaces are removed from the oneDAL library.

Installation

Check the System Requirements before installing to ensure compatibility with your system.

There are several options available for installing oneDAL:

• Binary Distribution: You can download pre-built binary packages from the following sources:
  • Intel® oneAPI:
    • Download as Part of the Intel® oneAPI Base Toolkit
    • Download as the Stand-Alone Intel® oneAPI Data Analytics Library

    Channel	Version
    intel
    conda-forge

    Examples

    • oneAPI interfaces with SYCL support
    • oneAPI interfaces without SYCL support
    • DAAL interfaces

    Documentation

    • Release Notes
    • Get Started Guide
    • Developer Guide and Reference

    Other related documentation:

    • daal4py documentation
    • Intel(R) Extension for Scikit-learn* documentation
    • oneDAL Specifications

    Apache Spark MLlib

    oneDAL library is used for Spark MLlib acceleration as part of OAP MLlib project and allows you to get a 3-18x increase in performance compared to the default Apache Spark MLlib.

    

    Technical details: FPType: double; HW: 7 x m5.2xlarge AWS instances; SW: Intel DAAL 2020 Gold, Apache Spark 2.4.4, emr-5.27.0; Spark config num executors 12, executor cores 8, executor memory 19GB, task cpus 8

    Scaling

    oneDAL supports distributed computation mode that shows excellent results for strong and weak scaling:

    oneDAL K-Means fit, strong scaling result	oneDAL K-Means fit, weak scaling results

    Technical details: FPType: float32; HW: Intel Xeon Processor E5-2698 v3 @2.3GHz, 2 sockets, 16 cores per socket; SW: Intel® DAAL (2019.3), MPI4Py (3.0.0), Intel® Distribution Of Python (IDP) 3.6.8; Details available in the article https://arxiv.org/abs/1909.11822

    Governance

    The oneDAL project is governed by the UXL Foundation and you can get involved in this project in multiple ways. It is possible to join the AI Special Interest Group (SIG) meetings where the group discuss and demonstrates work using this project. Members can also join the Open Source and Specification Working Group meetings.

    You can also join the mailing lists for the UXL Foundation to be informed of when meetings are happening and receive the latest information and discussions.

    You can contribute to this project and also contribute to the specification for this project, read the CONTRIBUTING page for more information.

    Support

    Ask questions and engage in discussions with oneDAL developers, contributers, and other users through the following channels:

    You may reach out to project maintainers privately at onedal.maintainers@intel.com.

    Security

    Contribute

    We welcome community contributions. Check our contributing guidelines to learn more. You can also contact the oneDAL team via UXL Foundation Slack using #onedal channel.

    License

    oneDAL is distributed under the Apache License 2.0 license. See LICENSE for more information.

    oneMKL FPK microlibs are distributed under Intel Simplified Software License. Refer to third-party-programs-mkl.txt for details.