Research area · 2005–
How do you design and evaluate an experience that combines sound, image, gesture and space?
The stated emphasis on Lattes is multimedia software, and the line runs through Giordano Cabral's entire career: systems that teach percussion by responding to gesture (2005), audio on sharing networks (2009), graphics with IMPA (2010), computer vision for malaria diagnosis (2013) and for dance movement analysis (2022), automatic generation of musical visualizations (2021), live video, motion capture and mixed reality with Voxar Labs. It is also the oldest line taught in the classroom: 21 editions of Introdução à Multimídia (Introduction to Multimedia).
01 · Multimedia, computer vision and mixed reality
Contributions
Framework for educational percussion systems · 2005
A Framework to Percussive Educational Systems (IEEE International Symposium on Multimedia, Irvine, 2005; doi.org/10.1109/ism.2005.7), with Suzana Maranhão, Matheus Gois and Erika Araújo: an architecture for systems that teach percussion by responding to gesture.
Audio in file-sharing networks · 2009
Improving audio files availability in file sharing networks (WebMedia 2009; doi.org/10.1145/1858477.1858493), with Márcio Dahia, Geber Ramalho, Fernando Trinta and Guerra. In the same period, Cabral took part in the Brazilian Network of Visualization Technologies (Rede Brasileira de Tecnologias de Visualização, CAJOC/RBV II, FINEP, 2008–), coordinated by Geber Ramalho.
Guitar-Leading Band · 2010
Poster at SIGGRAPH 2010 (doi.org/10.1145/1836845.1836937), with Marcelo Cicconet, Luiz Velho and Paulo Cezar Carvalho, of IMPA. The same affiliation also led to two doctoral committees at IMPA, in 2009 and 2010, with Briot and Pachet.
LiVES · 2011
Free real-time video platform, Gabriel Finch's dissertation (UFRPE, 2011), advised by Cabral.
Automatic malaria diagnosis · 2013
A proposal for automatic diagnosis of malaria (WWW 2013 Companion, workshop on public health in the digital age; doi.org/10.1145/2487788.2488022), with Allisson Oliveira and Jones Albuquerque: computer vision applied to a health problem.
Gesture and motion capture · 2013–2022
Avaliando Interfaces Gestuais para Prática de Instrumentos Virtuais de Percussão (SBCM 2013; PDF in the proceedings); V-Conga, a case study on which gestural nuances the Leap Motion captures (15th SBCM 2015); and the dissertation by Alessandra Aleluia Alves, AMA: um sistema especialista de aprendizado para balé adulto através de feedback verbal automático (no. 1,988, 01/18/2022), supervised by Cabral, on movement analysis in dance using computer vision.
Ritmaker · 2019
FACEPE/Centelha project led by Rodrigo Pereira: a magnetic board whose pieces are recognized by an augmented reality app for composing; compositions created in class can be saved, exported and shared.
Mandrit · 2021
A system for automatically generating visualizations for rhythmic analysis, and a survey of the challenges of generating musical visualizations, with Rute Moura and Horhanna Almeida (SBCM 2021).
Mixed Reality Laptops · 2022
A protocol for evaluating parallax viewing experiences on consumer laptops, using only the RGB camera already built into the notebook instead of wearable sensors: Fish Tank VR with the Parallax Engine and an experience and presence protocol. Mixed Reality Laptops: a protocol to evaluate enhanced viewing experiences on consumer laptops using Parallax Engine (SVR 2022, pp. 29–38; doi.org/10.1145/3604479.3604505), with twelve authors, among them Jarbas Jácome, Walter Correia, Veronica Teichrieb, Fabio Q. B. da Silva and André L. M. Santos. It is the work from the line with Voxar Labs, the virtual and augmented reality laboratory at CIn directed by Veronica Teichrieb, with which Cabral collaborates.
Mixed reality patent with Samsung · 2024
The same project, carried out with Samsung, resulted in the patent BR 10 2024 018431-9, Sistema e método para controlar uma posição de uma câmera virtual com seis graus de liberdade usando rastreamento de face de um usuário, e, meio legível por computador não transitório (System and method for controlling a position of a virtual camera with six degrees of freedom using face tracking of a user, and non-transitory computer-readable medium): the laptop webcam and deep learning detect the user's head pose and move the scene's virtual camera in six degrees of freedom, with no glasses or extra sensor. Filed on 09/06/2024 by Samsung Eletrônica da Amazônia and UFPE and published on 03/24/2026, it has sixteen inventors, including Cabral (Google Patents).
Auto da Compadecida opera · 2022
At the Festival de Ópera do Recife (Teatro Santa Isabel, August 4–7, 2022), a generative starry sky and body-controlled fire, by Jarbas Jácome and Ricardo Scholz, with MusTIC and Voxar (CIn portal, August 4, 2022).
02 · Multimedia, computer vision and mixed reality
Examining committees in the field
Doctoral examinations of Alana Elza Fontes da Gama (rehabilitation with virtual and augmented reality, 2015), Manoela Milena Oliveira da Silva (augmented reality in education, 2022) and Ricardo Borges Brazileiro (HyLeD, tangible interfaces, 2026).
Continues at: Voxar Labs and in the courses Introdução à Multimídia and Tendências em Mídia e Interação.