Hello Visitor!

Creativeapplications.Net (CAN) is a community of creative practitioners working at the intersection of art, media and technology.
Login
Status
Register | Forgot Password
Online for 6,368 days (17 years, 5 months, 8 days), published 4,109 articles about 2,872 people, featuring 193 tools, supported by 1,713 members, and providing access to 430 students.
Categories
CAN (94) Education (32) Event (255) Member (291) News (877) NFT (255) Project (2547) Review (46) Theory (54) Tutorial (39)
Log
Links

  • STextCopy to Clipboard (Text)
    Title + (Year) + People + URL
    /ImageGenerate Image
    PNG File Download (1080x1920)
    Copy URL to Clipboard
  • The Anemoia Device is a scent-memory machine that uses generative AI to distill photographs into bespoke fragrances. Guided by language models, a dial-based interface, and a custom olfactory formulation system, each image becomes a singular scent composition — a multisensory memory that evokes anemoia: nostalgia for a moment you never lived.

    Read our paper in NeurIPS 2025

    The system begins with a vision-language model (VLM) that interprets an analogue photograph and produces an objective semantic caption displayed on the integrated screen. Three rotary dials then lead the creation of a prompt, shaped through constrained inputs:

    Dial 1 — Subject (Perspective)


    Selects a particular point-of-view within the scene (e.g. old man, tree, bicycle) and classifies it as living or non-living to define the following parameters.

    Dial 2 — Time (Temporal Context)


    Positions the chosen subject within a contextual lifecycle.
    Living: childhood, youth, adulthood, elderly
    Non-living: raw material, manufacture, in-use, decay

    Dial 3 — Mood (Affective Tone)


    Assigns an emotional tone: happy, sad, calm, or angry.

    These inputs are synthesised into a structured prompt for a large language model (LLM), which takes the form of a concise narrative; an interpretive bridge between the photograph and its eventual olfactory form. This narrative is the basis for a cross-modal translation stage in which an LLM produces a scent formula using few-shot in-context learning.

    A curated scent library and an olfactory knowledge base underpin this translation. Each fragrance in the library is defined by semantic descriptors, with examples in the knowledge base pairing narratives with a sparse scent vector and a rationale. The model analyses the generated prompt against these examples and returns a proportional blend of up to four fragrances that align with the prompt’s emotional and thematic structure.

    The scent is then materialised through a custom olfactory display, with pump timings computed from the formula, activating peristaltic pumps that draw from glass vials and dispense their contents into a shared blending vessel. This process echoes the metaphor of distillation, with memory condensed into olfactory form through a systematic, multi-stage process.

    Pipeline ArchitectureHardwareSoftware
    1. VLM-based image captioning / segmentation
    2. LLM subject classification
    3. Dial-based parameter selection (Subject / Time / Mood)
    4. Prompt creation via LLM
    5. Semantic-to-olfactory mapping using few-shot in-context learning
    6. Scent rendering through olfactory display
    XIAO ESP32S3 microcontroller
    Custom CNC-milled PCB
    12V DC peristaltic pumps
    Modular aluminium frame with laser-cut frosted acrylic
    3D-printed internal mounts (PLA)
    Silicone tubing and glass reservoirs
    Multi-modal image analysis for semantic extraction
    LLM pipeline for narrative generation and cross-modal translation
    Orchestration layer: coordinating vision, language, and olfactory subsystems
    Embedded control firmware for real-time actuation and pump timing

    The device itself is vertically structured around this metaphor; a memory entering at the top and a scent emerging below. Internal subsystems (logic, relays, reservoirs, pumps) are physically separated to minimise interference. Structural elements blend CNC-milled PCBs, 3D-printed joints, and laser-cut acrylic for a layered, translucent aesthetic that echoes the machine’s conceptual focus on memory, transformation, and atmosphere.

    Project Page | Cyrus Clarke | Twitter/X | Instagram | LinkedIn | Tangible Media Group

    Development of the device is led by MIT Media Lab researcher Cyrus Clarke at the Tangible Media Group. The Anemoia Device demonstrates how multimodal AI systems can be orchestrated into a cohesive pipeline that spans perception, narrative generation, semantic mapping, and material output, forming a fully tangible system for computational memory-making.

    (A) peristaltic pumps (x4), (B) 12V relay modules (x4), (C) arduino uno (input controller), (D) LCD screen module, (E) custom PCB with XIAO ESP32S3 (output controller), (F) KY-040 rotary encoder modules (x3), (H) USB webcam.
  • C,
  • P Cyrus Clarke, Tangible Media GroupTangible Media Group at the MIT Media Lab Invent new tangible and embodied interactions that inspire and engage people. https://www.media.mit.edu/groups/tangible-media/overview/
  • T 3D Printing3D printing, or additive manufacturing, is the construction of a three-dimensional physical object from a CAD model or a digital 3D model., Acrylic, Aluminium, ArduinoArduino is an open-source electronics prototyping platform based on flexible, easy-to-use hardware and software. It’s intended for artists, designers, hobbyists, and anyone interested in creating interactive objects or environments. http://www.arduino.cc/, C++, ChatGPTChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022., ClaudeClaude is a series of large language models developed by Anthropic. https://claude.ai, CNCCNC stands for Computer Numerical Control, which is a manufacturing method that uses pre-programmed software to control machine tools. CNC machines are used to cut, drill, mill, and grind materials like metal, plastic, wood, and glass., Laser CuttingLaser cutting is a technology that uses a laser to vaporize materials, resulting in a cut edge., PCBA printed circuit board (PCB), also called printed wiring board (PWB), is a laminated sandwich structure of conductive and insulating layers., PythonPython is an interpreted, high-level, general-purpose programming language. Created by Guido van Rossum and first released in 1991, Python’s design philosophy emphasizes code readability with its notable use of significant whitespace.
  • Activity Log
    Join our Community to View/Add Comments.
    Title Excerpt Metadata Color