Tools
Creative Technology Taxonomy.
See laserpilot.github.io/creative_tech_taxonomy for more.
See laserpilot.github.io/creative_tech_taxonomy for more.
- AudioLDM2 (1)* Audio Generation with Self-supervised Pretraining https://audioldm.github.io/audioldm2/
- ChatGPT (21)* ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022.
- ClarifAI (1)* Clarifai is a full stack enterprise AI platform to build AI faster, including Large Language Models (LLMs), Generative AI, Retrieval Augmented Generation (RAG), data labeling, inference, and more. https://www.clarifai.com
- Claude (1)* Claude is a series of large language models developed by Anthropic. https://claude.ai
- Custom AI Model (3)
- Dall-E (5)* DALL·E 2 is an AI system that can create realistic images and art from a description in natural language. https://openai.com/
- Gemma AI (1)* Gemma is a collection of lightweight, open models built from the same technology that powers our Gemini models. https://ai.google.dev/gemma/docs
- Google Gemini (5)* Gemini, formerly known as Bard, is a generative artificial intelligence chatbot developed by Google. Based on the large language model (LLM) of the same name, it was launched in 2023 and previously based on PaLM, and initially the LaMDA family of large language models. https://gemini.google.com
- Llama (3)* The Llama model is a series of accessible, open-weight large language models (LLMs) developed by Meta, available for developers, researchers, and businesses. https://www.llama.com
- Midjourney (3)* Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco-based research lab Midjourney. https://www.midjourney.com
- Mistral (2)* MistralI is a powerful language model created by a French artificial intelligence (AI) startup Mistral AI. https://mistral.ai/
- MusicGen (1)
- RunwayML (2)* RunwayML is a set of machine learning tools for media ranging from video, audio, to text. https://runwayml.com
- SmolLM2 (1)* SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device. https://ollama.com/library/smollm2
- Speech-2Face (1)* Created by a team led by researchers from MIT’s Computer Science and Artificial Intelligence Lab (CSAIL), Speech-2Face can produce a predicted image of someone’s face from hearing them talk for only five seconds. https://speech2face.github.io
- Stable Diffusion (14)* Stable Diffusion is a deep learning, text-to-image model released in 2022 based on diffusion techniques. https://stability.ai
- Video-Retalking (1)* Audio-based Lip Synchronization for Talking Head Video https://replicate.com/chenxwh/video-retalking
- YOLOv8 (1)* YOLOv8 is a computer vision model architecture developed by Ultralytics. https://yolov8.com
- ARKit (2)* ARKit is an application programming interface (API) for iOS, iPadOS and VisionOS which lets third-party developers build augmented reality apps, taking advantage of a device's camera, CPU, GPU, and motion sensors.
- Azure Emotion API (1)* Microsoft Azure Emotion API, which allows you to build more personalized apps with Microsoft's cutting-edge cloud-based emotion recognition algorithm. https://learn.microsoft.com/en-us/azure/ai-services/computer-vision/overview-identity
- Firebase (11)* Firebase is a set of backend cloud computing services and application development platforms provided by Google.
- Google Images API (2)
- Google Maps API (14)* API for using Google Maps and integrating it into your own projects https://developers.google.com/maps/documentation
- Google Translate API (2)* Cloud Translation API uses Google's neural machine translation technology to let you dynamically translate text through the API using a Google pre-trained machine learning model. https://cloud.google.com/translate
- Google Vision API (2)* Google Vision API allows for integration of tools that can use machine learning to understand visual content in images and videos, detecting objects, faces, landmarks, and text.
- Liquidsoap (1)* Liquidsoap is a powerful tool for building complex audio and video stream generators, typically targeting internet radios and webtvs. https://www.liquidsoap.info
- Magic Studio API (1)* Effortlessly add and remove objects or backgrounds with Magic Studio APIs. https://magicstudio.com/apis/
- MusicGen API (1)* Generate music from a prompt or melody. https://replicate.com/meta/musicgen/api
- News API (1)
- Newscatcher API (1)* The NewsCatcher API lets you tap into a wealth of news articles from various sources around the globe. https://www.newscatcherapi.com
- OpenWeatherMap API (1)* OpenWeatherMap is an online service, owned by OpenWeather Ltd, that provides global weather data via API, including current weather data, forecasts, nowcasts, and historical weather data. https://openweathermap.org
- Replicate (1)
- SocketIO (7)* Bidirectional and low-latency communication for every platform. https://socket.io
- Stanza.API (1)* Stanza is a collection of accurate and efficient tools for the linguistic analysis of many human languages. Starting from raw text, Stanza divides it into sentences and words, and then can recognize parts of speech and entities, do syntactic analysis, and more. Stanza brings state-of-the-art NLP models to languages of your choosing. https://stanfordnlp.github.io/stanza/
- Adobe Air (4)* AIR is a runtime environment that allows Adobe Animate content and ActionScript 3.0 coders to construct applications and video games that run as a stand-alone.
- Box2D (15)* Box2D is a free open source 2-dimensional physics simulator engine written in C by Erin Catto and published under the MIT license. https://box2d.org
- Cocos (4)* Cocos is a cross-platform 2D&3D engine and development kit. https://www.cocos.com
- Octane (4)* Octane Render is an unbiased rendering application with real-time capability developed by graphics software company OTOY Inc. https://home.otoy.com/render/octane-render/
- Unity (75)* Unity is a cross-platform game engine developed by Unity Technologies, first announced and released in June 2005 at Apple Inc.’s Worldwide Developers Conference as a Mac OS X-exclusive game engine. As of 2018, the engine had been extended to support more than 25 platforms. https://unity.com
- Unreal (14)* Unreal Engine (UE) is a 3D computer graphics game engine developed by Epic Games, first showcased in the 1998 first-person shooter video game Unreal. https://www.unrealengine.com/
- 3D Printing (98)* 3D printing, or additive manufacturing, is the construction of a three-dimensional physical object from a CAD model or a digital 3D model.
- CNC (38)* CNC stands for Computer Numerical Control, which is a manufacturing method that uses pre-programmed software to control machine tools. CNC machines are used to cut, drill, mill, and grind materials like metal, plastic, wood, and glass.
- Laser Cutting (26)* Laser cutting is a technology that uses a laser to vaporize materials, resulting in a cut edge.
- BasilJs (2)* basil.js is allows designers and artists to individually expand the possibilities of Adobe InDesign in order to create complex projects in data visualization and generative design. https://basiljs.ch/
- C4 (1)* C4 is broad framework that is integrated tightly with Apple’s native UIKit. http://www.c4ios.com/
- Cinder (67)* Cinder provides a powerful, intuitive toolbox for programming graphics, audio, video, networking, image processing and computational geometry. Cinder is cross-platform, and in general the exact same code works under Mac OS X, Windows and a growing list of other platforms — most recently the iPhone and iPad. http://libcinder.org/
- Cycle.js (1)* A functional and reactive JavaScript framework for predictable code. https://cycle.js.org
- d3 (8)* Originally developed by United Visual Artists, d3 is a platform (software/hardware) to control real-time spectacles from live shows and immersive xR broadcasts to the virtual productions in one end-to-end workflow. https://www.disguise.one/
- Hydra (6)* Set of tools for livecoding networked visuals. Inspired by analog modular synthesizers. https://github.com/hydra-synth/hydra
- Max (101)* Max gives you the parts to create sounds, visuals, and interactive media. https://cycling74.com/products/max
- Next.js (2)* Next.js enables you to create high-quality web applications with the power of React components. https://nextjs.org
- NodeJs (36)* Node.js is a cross-platform, open-source JavaScript runtime environment that can run on Windows, Linux, Unix, macOS, and more.
- Nodes (2)* Nodes is a JavaScript-based 2D canvas for computational thinking. It’s powered by web technologies and the npm ecosystem. https://nodes.io
- openFrameworks (383)* openFrameworks is a c++ library designed to assist the creative process by providing a simple and intuitive framework for experimentation.The code is written to be massively cross-compatible currently supporting five operating systems (Windows, OSX, Linux, iOS, Android) and four IDEs (XCode, Code::Blocks, and Visual Studio and Eclipse). https://openframeworks.cc
- OPENRNDR (2)
- p5js (19)* p5.js a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing. https://p5js.org
- PaperJs (9)* Paper.js is an open source vector graphics scripting framework that runs on top of the HTML5 Canvas. http://paperjs.org
- PlatformIO (2)* A lightweight and highly customizable UI toolkit for developing complex, data-dense, and platform independent graphical instruments. https://platformio.org
- Plugdata (1)* A visual programming environment for audio experimentation, prototyping and education https://plugdata.org
- Processing (456)* Processing is an open source programming language and environment to create images, animations, and interactions. Initially developed to teach fundamentals of computer programming within a visual context, Processing also has evolved into a tool for generating finished professional work. Today, there are tens of thousands of students, artists, designers, researchers, and hobbyists who use Processing for learning, prototyping, and production. https://processing.org
- Pure Data (24)* Pure Data (Pd) is a visual programming language developed by Miller Puckette in the 1990s for creating interactive computer music and multimedia works. https://puredata.info
- Quarz Composer (11)* Quartz Composer is a graphics development environment that allows you to explore the incredible power of the graphics stack of Mac OS X. http://developer.apple.com/graphicsimaging/quartz/quartzcomposer.html
- SuperCollider (14)* A platform for audio synthesis and algorithmic composition, used by musicians, artists and researchers working with sound. https://supercollider.github.io
- ThreeJs (25)* Three.js is a cross-browser JavaScript library and Application Programming Interface used to create and display animated 3D computer graphics in a web browser. Three.js uses WebGL. https://threejs.org
- TouchDesigner (29)* TouchDesigner is a node based visual programming language for real time interactive multimedia content, developed by the Toronto-based company Derivative. It’s been used by artists, programmers, creative coders, software designers, and performers to create performances, installations, and fixed media works. https://derivative.ca
- Vanilla JS (4)* Vanilla JS is a fast, lightweight, cross-platform framework for building powerful JavaScript applications. http://vanilla-js.com
- Vercel AI SDK (1)* The AI SDK is the TypeScript toolkit designed to help build AI-powered applications and agents with React, Next.js, Vue, Svelte, Node.js, and more. https://ai-sdk.dev
- Vue.Js (2)* Vue is a JavaScript framework for building user interfaces. https://vuejs.org
- vvvv (80)* vvvv is a graphical programming environment for easy prototyping and development. It is designed to facilitate the handling of large media environments with physical interfaces, real-time motion graphics, audio and video that can interact with many users simultaneously. vvvv is currently windows only but there are plans to release a mac version in near future. http://vvvv.org/
- Arduino (367)* Arduino is an open-source electronics prototyping platform based on flexible, easy-to-use hardware and software. It’s intended for artists, designers, hobbyists, and anyone interested in creating interactive objects or environments. http://www.arduino.cc/
- AT (10)* ATmega and ATtiny are commonly used in many projects and autonomous systems where a simple, low-powered, low-cost micro-controller is needed.
- AxiDraw (4)* AxiDraw is a simple, precise, and versatile pen plotter, capable of writing or drawing on almost any flat surface. https://axidraw.com
- Controllino (1)* Controllino is an industry-grade PLC based on open source software. Fully compatible with Arduino. https://www.controllino.com/
- Drone (18)* Done is an unmanned aerial vehicle (UAV) or unmanned aircraft system (UAS), with no human pilot, crew, or passengers on board, but rather is controlled remotely or is autonomous.
- Geiger Tube (4)* The Geiger–Müller tube or G–M tube is the sensing element of the Geiger counter instrument used for the detection of ionizing radiation.
- Kinect (77)* Kinect is a discontinued line of motion sensing input devices produced by Microsoft and first released in 2010. The devices generally contain RGB cameras, and infrared projectors and detectors that map depth through either structured light or time of flight calculations, which can in turn be used to perform real-time gesture recognition and body skeletal detection, among other capabilities.
- Leap Motion (9)* A computer hardware sensor device that supports hand and finger motions as input, analogous to a mouse, but requires no hand contact or touching. https://www.ultraleap.com
- LiDAR (16)* LiDAR, which stands for Light Detection and Ranging, is a remote sensing method that uses light in the form of a pulsed laser to measure distances. It creates detailed 3D representations of surfaces, making it useful for mapping terrain, vegetation, and even archaeological features.
- PCB (32)* A printed circuit board (PCB), also called printed wiring board (PWB), is a laminated sandwich structure of conductive and insulating layers.
- Pen Plotter (9)
- Projector (184)* A projector or image projector is an optical device that projects an image (or moving images) onto a surface, commonly a projection screen. https://www.creativeapplications.net/tutorial/guide-to-projectors-for-interactive-installations/
- Quest (20)* Meta Quest 3 is a standalone virtual reality (VR) headset developed by Reality Labs, a division of Meta Platforms.
- Raspberry Pi (82)* Raspberry Pi is a series of small single-board computers (SBCs) developed in the United Kingdom. https://www.raspberrypi.com
- Teensy (7)* The Teensy is a USB-based microcontroller development system, in a very small footprint, capable of implementing many types of projects. https://www.pjrc.com/teensy/
- Vision Pro (1)* The Apple Vision Pro is a mixed-reality headset developed by Apple. https://www.apple.com/apple-vision-pro/
- Webcam (20)* A webcam is a video camera which is designed to record or stream to a computer.
- XBee (4)* XBees are radio modules for reliable RF connectivity via cellular gateways. https://en.wikipedia.org/wiki/XBee
- AppleScript (1)
- C++ (92)
- Clojure (2)* Clojure is a dynamic, general-purpose programming language, combining the approachability and interactive development of a scripting language with an efficient and robust infrastructure for multithreaded programming. https://clojure.org
- GLSL (22)* OpenGL Shading Language (GLSL) is a high-level shading language with a syntax based on the C programming language. https://learnopengl.com/Getting-started/Shaders
- Grbl (1)* Grbl is a low cost alternative to parallel-port-based motion control for CNC milling. It runs on a vanilla Arduino as long as it sports an Atmega 328. https://github.com/grbl/grbl
- Java (17)* Java is a set of computer software and specifications developed by James Gosling at Sun Microsystems, which was later acquired by the Oracle Corporation, that provides a system for developing application software and deploying it in a cross-platform computing environment. https://www.java.com
- Javascript (164)
- Lua (1)* Lua is a powerful, efficient, lightweight, embeddable scripting language. It supports procedural programming, object-oriented programming, functional programming, data-driven programming, and data description. https://www.lua.org
- Python (80)* Python is an interpreted, high-level, general-purpose programming language. Created by Guido van Rossum and first released in 1991, Python’s design philosophy emphasizes code readability with its notable use of significant whitespace.
- WebGL (31)
- BLIP (1)* BLIP effectively utilizes the noisy web data by bootstrapping the captions, where a captioner generates synthetic captions and a filter removes the noisy ones. https://huggingface.co/docs/transformers/en/model_doc/blip
- d3.js (2)* d3.js is a JavaScript library for bespoke data visualization. https://d3js.org
- Depthkit (3)
- Hemesh (5)* A Java library for creating and manipulating polygonal meshes. Aimed primarily at Processing. https://github.com/wblut/HE_Mesh
- Hugging Face Diffusers (1)* Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. https://huggingface.co/
- ISF (1)* ISF is designed to provide a simple, reusable and open format for creating efficient hardware-accelerated interactive resources for media servers, VJ software, non-linear editors, creative coding environments. https://isf.video
- NeoPixel (7)* Created by Adafruit, NeoPixel is an Arduino library for controlling single-wire-based LED pixels and strip. https://github.com/adafruit/Adafruit_NeoPixel
- OpenCV (72)* OpenCV is a library of programming functions for real-time computer vision. https://opencv.org
- OpenNI (2)* OpenNI or Open Natural Interaction is an open source software project focused on certifying and improving interoperability of natural user interfaces and organic user interfaces for Natural Interaction (NI) devices.
- PixiJs (1)* PixiJS is a HTML5 creation engine and a flexible 2D WebGL renderer. https://pixijs.com
- Shiftr.io (1)* The IoT platform for interconnected projects to connect hardware and software using cloud service and/or desktop app. https://www.shiftr.io
- TensorFlow (16)* TensorFlow is a software library for machine learning and artificial intelligence. https://www.tensorflow.org
- thi.ng (9)* Open source building blocks for computational design by Karsten Schmidt. https://thi.ng
- ToxicLibs (17)* Toxiclibs is a set of Processing classes created for mostly computational design projects by Karsten Schmidt. https://github.com/postspectacular/toxiclibs
- Android (40)* Android is a mobile operating system based on a modified version of the Linux kernel and other open source software, designed primarily for touchscreen mobile devices such as smartphones and tablets.
- Google Cloud Run (1)* Cloud Run is a fully managed platform that enables you to run your code directly on top of Google's scalable infrastructure. https://cloud.google.com/run
- iOS (577)* iOS is a mobile operating system created and developed by Apple Inc. exclusively for its hardware. It is the operating system that presently powers many of the company’s mobile devices, including the iPhone, and iPod Touch.
- Linux (35)* Linux is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991.
- MacOS (118)* macOS, originally Mac OS X, previously shortened as OS X, is a Unix-based operating system developed and marketed by Apple since 2001.
- VisionOS (1)* VisionOS is a mixed reality operating system derived primarily from iPadOS and its core frameworks. https://developer.apple.com/visionos/
- Web (109)* Projects created to run client–server computer programs in a web browser.
- Windows (79)* Windows is a product line of proprietary graphical operating systems developed and marketed by Microsoft.
- DMX (32)* DMX (Digital Multiplex) is a protocol used to control devices such as lights or fog machines.
- MIDI (39)* MIDI stands for Musical Instrument Digital Interface. It's a technical standard that allows electronic devices to communicate with each other to play, record, and edit music.
- MQTT (1)* MQTT (Message Queuing Telemetry Transport) is a messaging protocol that allows devices to communicate with each other over the internet. https://en.wikipedia.org/wiki/MQTT
- OSC (67)* Open Sound Control (OSC) is a protocol for networking sound synthesizers, computers, and other multimedia devices for purposes such as musical performance or show control.
- 3ds Max (8)* Autodesk 3ds Max, formerly 3D Studio and 3D Studio Max, is a professional 3D computer graphics program for making 3D animations, models, games and images.
- Ableton Live (62)* Ableton Live is a digital audio software for macOS and Windows developed by the German company Ableton.
- Adobe Animate (1)
- After Effects (25)* Adobe After Effects is a digital visual effects, motion graphics, and compositing application developed by Adobe Inc.
- Blender (20)* Blender is a free and open source 3D modelling, animation and rendering software. https://www.blender.org
- Chataigne (1)* Chataigne is a free, open-source software made with one goal in mind : create a common tool for artists, technicians and developers. http://benjamin.kuperberg.fr/chataigne/
- Cinema 4D (27)* Cinema 4D is a 3D software suite developed by the German company Maxon. https://www.maxon.net/en/cinema-4d
- CloudCompare (1)* CloudCompare is a 3D point cloud (and triangular mesh) editing and processing software. https://www.danielgm.net
- ComfyUI (5)* ComfyUI is an open source, node-based program that allows users to generate images from a series of text prompts. It uses free diffusion models such as Stable Diffusion as the base model for its image capabilities combined with other tools such as ControlNet and LCM Low-rank adaptation with each tool being represented by a node in the program. https://github.com/comfyanonymous/ComfyUI
- Cubase (1)
- DaVinci Resolve (2)* DaVinci Resolve combines editing, color correction, visual effects, motion graphics and audio post production in one software tool. https://www.blackmagicdesign.com/uk/products/davinciresolve
- Director (3)* Macromedia Director is a multimedia authoring tool to create Macromedia Shockwave content.
- Electron (1)* Electron allows you to build cross-platform desktop apps with JavaScript, HTML, and CSS. https://www.electronjs.org
- FL-Studio (1)* FL Studio is a digital audio workstation (DAW) developed by the Belgian company Image-Line. It features a graphical user interface with a pattern-based music sequencer. https://www.image-line.com
- Flash (104)* Adobe Flash Player is computer software for using content created on the Adobe Flash platform, including viewing multimedia contents, executing rich Internet applications, and streaming audio and video. Flash Player can run from a web browser as a browser plug-in or on supported mobile devices.
- Fusion 360 (7)* Autodesk Fusion is an integrated 3D modeling cloud-based CAD/CAM/CAE/PCB platform. https://www.autodesk.com/education/edu-software/fusion
- Glyphs (1)* Glyphs is a Mac font editor. https://glyphsapp.com
- Houdini (24)* Houdini is a 3D animation software application developed by Toronto-based SideFX, who adapted it from the PRISMS suite of procedural generation software tools. https://www.sidefx.com
- Hunyuan3D (1)
- LM Studio (1)* Run local AI models like gpt-oss, Qwen, Gemma, DeepSeek and many more on your computer, privately and for free. https://lmstudio.ai
- Logic Pro (1)
- MadMapper (6)* MadMapper is a collaborative software project between the french installation studio 1024 architecture and the swiss software makers GarageCube. https://madmapper.com
- Maya (15)* Autodesk Maya is 3D visual effects software for character creation, rigging, animation and simulation. https://www.autodesk.com/uk/products/maya/
- Millumin (1)* Complete solution for creating audio-visual shows. https://www.millumin.com
- Nodal (1)* Nodal is generative software for composing music, interactive real-time improvisation, and a musical tool for experimentation and play. https://nodalmusic.com
- Ollama (2)* Ollama is software to run large language models. https://ollama.com
- Qidi (1)
- Redshift (1)* Redshift is a 3D rendering software by Maxon. https://www.maxon.net/en/redshift
- Resolume (3)* Resolume is the software for VJ-ing comprised of Arena Media Server and Avenue VJ Software. https://www.resolume.com
- Rhinoceros 3D (27)* Rhinoceros (typically abbreviated Rhino or Rhino3D) is a commercial 3D computer graphics and computer-aided design (CAD) application software that was developed by TLM, Inc.
- Simscale (1)* SimScale is a full-cloud CAE simulation software that helps you perform CFD, FEA, and thermal simulations for CAD models in the cloud. https://www.simscale.com
- SolidWorks (4)* SolidWorks is software used for solid modeling computer-aided design (CAD) and computer-aided engineering (CAE). https://www.solidworks.com
- TouchOSC (8)* TouchOSC is an environment that allows you to create control interfaces. It can send and receive messages to / from hosts which respond to OSC. https://hexler.net/touchosc
- VDMX (7)* VDMX is software for live visual performance created by David Lublin. http://davidlubl.in/vdmx
- Wekinator (7)* Wekinator allows anyone to use machine learning to build new musical instruments, gestural game controllers, computer vision or computer listening systems, and more. http://www.wekinator.org
AI Model
API
Engine
Fabrication
Framework
Hardware
Language
Library
Material
Platform
Protocol
Software
