logo logo
  • Home
  • About Us
    • Overview
    • Team
  • Solutions
    • Text Classification
    • Question Answering
    • Product Recommendations
  • Resources
    • Installation instructions
    • Get Trial License
    • Blog
    • Webinars
    • Press
  • Careers
  • Contact us
  • Bolt
    • Overview
    • Installation instructions
    • Use Bolt In Your Project
  • BoltNew
    • Overview
    • Installation instructions
    • Try BOLT
logo logo
  • Home
  • About Us
    • Overview
    • Team
  • Solutions
    • Text Classification
    • Question Answering
    • Product Recommendations
  • Resources
    • Installation instructions
    • Get Trial License
    • Blog
    • Webinars
    • Press
  • Careers
  • Contact us
  • Bolt
    • Overview
    • Installation instructions
    • Use Bolt In Your Project
Twitter Instagram Linked In
Return to previous page
Home

Bolt FAQs

BOLT: Frequently Asked Questions

Please reach us at bolt@thirdai.com if you cannot find an answer to your question.

What is Bolt?

BOLT is an acceleration engine for neural network training built by ThirdAI Corp. Please refer to this link.

What is the essential ingredient of BOLT that makes it an AI powerhouse?

Read more about the technology here.

How do we use BOLT?

ThirdAI provides an easy-to-use Python package with an interface that closely resembles the standard open source training frameworks (like Keras). We also have a built in model converter that can take in a Keras model and then train it using our BOLT engine. The sample training scripts for training a BOLT network and training a Keras model using our BOLT engine are shown on this page.

Is BOLT free to download and install for everyone?

As of now, a limited set of users will be given access to our BOLT package. Please apply for trial access here

Does BOLT support all types of models?

At present, BOLT supports Fully Connected Neural Networks. Soon, we will be adding functionality to train giant embedding models (like Facebook’s DLRM and Amazon’s DSSM), Graph Convolutional Networks (GCNs), Convolutional Neural Networks (CNNs), and more.

Are there any hyperparameters that a user needs to choose?

We have a single tunable hyperparameter called load_factor that determines how many computations BOLT needs to perform. A lower load_factor trains the model faster, but potentially at a lower accuracy gain per batch.

Is there any trade-off?

BOLT uses ever-so-slightly higher memory than a naïve model. However, compared with TensorFlow’s high level of model replication (effectively prohibiting large batch sizes on a single GPU), BOLT’s memory usage is much less, thereby allowing for unusually large batch sizes on large models. BOLT is an approximation and hence may require different fine tuning.

Is it true that you can train a 200 million network on a laptop?

Yes! On an M1 laptop with a mere 8 GB RAM, BOLT can train a 200 million parameter model 20% faster than an A100 GPU! Read details here.

logo

Third-AI builds hash-based processing algorithms that accelerate the training and inference of neural networks. The technology is a result of 10 years of innovation in finding fundamental ways to make deep learning more efficient.

Useful Links

  • About Us
  • Bolt
  • Team
  • Careers
  • News

Contact

  • Email: contact@thirdai.com
  • Address: 3200 Southwest Fwy, Suite 3120, Houston, Texas 77027
Facebook Twitter Instagram Linkedin
Tweets by ThirdAILab

Copyright © 2022. All Rights Reserved. ThirdAI Corp.

Click to Copy