Benchmarking

Artifact: PSMark: A Distributed IoT Benchmark for Publish/Subscribe Under Domain-Based Workloads

This is the artifact for PSMark. PSMark is a distributed, multi-protocol benchmark for evaluating topic-filtered publish/subscribe systems under workloads representative of real-world IoT deployments. It supports heterogeneous device configurations, …

PSMark: A Distributed IoT Benchmark for Publish/Subscribe Under Domain-Based Workloads

The Publish/Subscribe (pub/sub) paradigm is widely used in the Internet of Things (IoT). Standalone sensors, wearables, and other devices act as producers that publish messages to consumers such as edge servers or even other IoT devices. Selecting …

A Context-Aware Benchmarking Approach for Scenario-Based Evaluation of Smart Devices

Understanding how smart devices behave under real-world conditions remains challenging, as existing benchmarking tools often isolate metrics like energy consumption or protocol compliance without considering realistic interactions or coordinated use. …

A customizable benchmarking tool for evaluating personalized thermal comfort provisioning in smart spaces using Digital Twins

Providing proper thermal comfort to individual occupants is crucial to improve well-being and work efficiency. However, Heating, Ventilation, and Air Conditioning (HVAC) systems are responsible for a large portion of energy consumption and CO2 …

DEMO: Web-CozyBench - A Web-Based Platform to Benchmark Thermal Comfort Provision using Digital Twins

Web-CozyBench is a web-based benchmarking platform built on Co-zyBench to evaluate occupant-centric HVAC control systems using Digital Twin simulations. It provides a GUI for defining building and occupant scenarios, selecting control strategies, …

Co-zyBench

Heating, Ventilation, and Air Conditioning (HVAC) systems account for 40% to 50% of energy usage in commercial buildings, so controlling them while preserving occupants' comfort matters. State-of-the-art solutions use pervasive systems with sensors or smart devices to gauge individual thermal sensations, but assessing those methods is hard: real-world experiments are expensive, limited in access, and often overlook occupant and regional diversity.