Actuated textile-based physicalization with Vismock

Vismock is a data physicalization technique that combines smocked patterns on textiles with electronics to incorporate color and shape changes, supporting visual and tactile data representation. Our work is mainly motivated by data physicalization challenges about understanding the design space of physical data representations, especially dynamic, actuated, and interactive ones, and determining how to implement these designs. Using Vismock, we developed personal data physicalizations that represent people's progress towards completing tasks, their stress levels over time, and their running activity.

What is Vismock (Visualization + Smocking)?

Data physicalization is a research area that explores representing data attributes through manipulating the geometric and physical properties of tangible objects. Vismock is a data physicalization approach that leverages a fabric manipulation technique called 'smocking'. Vismock supports the creation of interactive and dynamic data physicalizations by extending the smocking technique with programmable components such as thermochromic pigments and shape memory alloys. Using a research-through-design methodology, we developed an initial design space for Vismock that shows how data can be represented using visual and tactile variables, as well as the affordances of Vismock. We demonstrated the generative power of our design space through four exemplars, created using Vismock. We use these exemplars to discuss the advantages and limitations of Vismock as a tool for data physicalization.

What smocking is about

(the one with textiles, not cigarettes)

Actuation

The primary component of Vismock is an augmented smocked pattern - a smocking display. To create a smocking display, we combine the American smocked pattern with programmable electronics to actuate textile shape and color. To create a smocked pattern, small stitches are sewn into the fabric using specific patterns. Such stitching can be done either manually or using a sewing machine. A smocked pattern can be developed using different types of fabrics such as cotton and linen. In our implementation, a smocking display is composed of a number of cells. A single cell within the smocking display is described as a square grid of a specific dimension that has a stitch design, and can be connected to a circuit that controls its color and shape.

A smocking display consists of a fabric layer, which we refer to as the heater layer, containing the electronics and the circuit, and a smocked pattern layer. The heater layer has two faces. On the front face, we sew conductive thread patterns that act like heating elements. The back face of the heater layer acts as a breadboard and connects to different parts of that heater layer using copper tape. To power and control our heater layer, we use an off-the-shelf microcontroller, Arduino Mega. MOSFET is used to control the current flow from an external power source to the circuit. To power our circuit, we use 3.7 volt rechargeable Li-Ion batteries with capacities higher than 1000mAh.

Vismock Implementation

Color Actuation

To support color actuation, we mix thermochromic pigments (with a variety of activation temperatures: Black-Colorless (38 C), Red-Yellow (31 C), and Green-Yellow (25 C))1 with white dye and paint the mix on the fabric surface. The thermochromic pigment is then actuated using the heater layer.

Thermochromic pigments typically enable a material to have two states – an original base color, and a changed color when applying heat over a certain threshold. When the material cools to a temperature below the threshold, it returns to its base color.

Color actuation (binary and continuous)

Shape Actuation

To support shape actuation, we use shape memory alloys (SMAs), such as shape memory wires and springs. These types of SMAs have a trained state. Applying current and heating the wires above their activation temperature causes these wires to go back to their trained state. to expand, we use NiTi shape memory alloy with wire trained state, of size 0.5mm, and transition temperature of 45C1. To compress, we use NiTi shape memory alloy with helical spring trained state, of size 0.5mm, a mandrel size of 8mm, a pitch of Wire size4, and a transition temperature of 45C2.

By setting the state of current flow to ‘on’ or ‘off’, or by controlling the time interval during which the current flows, we can either reach a specific shape state or animate an expansion or compression sequence.

Shape actuation (compression and expansion)

Vismock actuation in action

Design Space

We developed the Vismock design space that consists of three parts: independent variables, dependent variables, and affordances.

Independent variables

Independent variables are aspects of smocked patterns that can be modified independently from other parameters. They can be visual (cell size, number of cells, pattern kind and cell color) or tactile (cell stitch state, and cell temperature).

Each independent variable can be controlled either manually while making the smocking display, or by manual interaction or using electronics within the fabricated smocking display.

Dependent variables

Dependent variables are aspects of smocked patterns that are modified by varying independent variables. The dependent visual variables we explored are shape, shape size, shape position, and dynamic cell color. Shape in Vismock corresponds to each repeating unit of the smocked pattern and depends on the pattern kind. Shape size and position correspond to the characteristics of that unit within the entire pattern.

Dynamic cell color corresponds to the current color of the thermochromic pigments applied to the cell’s surface and depends on cell temperature. Shape depends on pattern kind and cell stitch state, while size and position depend on pattern kind, cell stitch state, and the size of the grid structure that the pattern is made from.

The dependent tactile variables we explored are roughness, lay, and compliance. Roughness in Vismock is modified through variations in the fabric caused from changes in shape. Lay depends on the orientation of the rows and columns of the pattern kind. Compliance refers to the capability of the pattern used to be compressed and expanded, which can range from high compliance like honeycomb, to relatively rigid like the flower shaped pattern, and depends on pattern kind and cell stitch state.

Affordances

Affordances in Vismock refer to the functional, sensory, physical, and cognitive affordance that when taken together correspond to how data represented using Vismock is being perceived, sensed, and used as a function of independent and dependent variables that represent data.

Functional affordances are design features that help users accomplish tasks. Functional affordances in Vismock encompass the ability of the system to close or open the stitches and to map the color value of a cell to a range of data values, which enables users to visualize quantitative, categorical, and ordinal data.

Sensory affordances are design features that help users sense something in support of cognitive or physical affordances. Sensory affordances in Vismock relates to temperature changes that pertain exclusively to the tactile sense (e.g., feeling data value changes), color changes to the visual sense (e.g., seeing trend), and compliance, lay, and roughness to both tactile and visual senses (e.g., extent of roughness could indicate differences in data values).

Physical affordances are design features that help users in doing a physical action. Physical affordances in Vismock are about compliance as it helps users compress and expand the smocking display to perform operations such as zooming in and out. Cognitive affordances are design features that help users in knowing something. Cognitive affordances in Vismock relate to lay, compliance, and roughness as they help users in knowing the characteristics of the smocking display. For example, high compliance can enable users to know that the pattern can be compressed and expanded or lay can communicate that there is a trend in the visualized dataset.

Cognitive affordances are design features that help users in knowing something. Cognitive affordances in Vismock relate to lay, compliance, and roughness as they help users in knowing the characteristics of the smocking display. For example, high compliance can enable users to know that the pattern can be compressed and expanded or lay can communicate that there is a trend in the visualized dataset.

Project Publications

  • VIS
    Bahare Bakhtiari, Charles Perin, Sowmya Somanath VISMOCK: A Programmable Smocking Technique for Creating Interactive Data Physicalization IEEE VIS 2025 Electronic Conference Proceedings, Vienna, Austria. IEEE. 2025.
  • Input Visualization
    Bahare Bakhtiari, Sowmya Somanath, Charles Perin Repeated Actions in Fabric Manipulation Crafts as an Opportunity for Input Physicalization Proceedings of the IEEE VIS 2025 Workshop: Envisioning a Research Agenda for Input Visualization, Vienna, Austria. 2025.
  • Physicalization from Theory to Practice
    Bahare Bakhtiari, Charles Perin, Sowmya Somanath Using Ephemerality and Integration with Everyday Objects as Strategies for Improving Personal Data Privacy through VISMOCK Proceedings of the ACM DIS 2024 workshop: Physicalization from Theory to Practice, Copenhagen, Denmark. 2024.
  • DIS
    Bahare Bakhtiari, Charles Perin, Sowmya Somanath VISMOCK: A Programmable Smocking Technique for Creating Interactive Data Physicalization Proceedings of the Conference on Designing Interactive Systems (DIS 2024), July 2024, Copenhagen, Denmark. ACM. 2024.
  • GI
    Bahare Bakhtiari, Charles Perin, Sowmya Somanath Investigating the Potential for Smart Garments as Extension for Mobile to Support In-Situ Tasks GI 2023 posters, May 2023, Victoria, BC, Canada. Canadian Information Processing Society. 2023.