I wish to thank warmly all Hackathon participants for their valuable insights and intellectual inputs, namely Martin Gális, Jan Hajič, Šimon Libřický, Tomáš Klapka, Jonatán Müller, Adam Pospíšil, German Angel Puerto, Ondřej Skovajsa and Ieva Weaver.

It was a genuine pleasure to work with you all!

#RomaniChords

🧵18/20

Overall, in about 27 hours, we tackled various research problems and challenges.

Some we managed to solve, others we just named (which is equally important for future work).

And yes, there may be another #Hackathon for data analysis as soon as the data is collected (perhaps in late 2027).

If you are interested, just keep an eye on the #RomaniChords hashtag or sign up for e-mail updates on the project’s website (=> http://romanichords.eu/)

#RomaniChords

🧵17/20

For guitar-based data, we needed to tackle mainly the abundant short notes – data noise occurring likely as a result of imperfect onboard #midi processing.

We managed to fix this with Midi transform functions in #LogicPro.

Accordion was already giving us usable data, so we only worked on separating the midi channels for trebles and basis.

(Kudos to Šimon Libřický, our Logic Pro Expert!)

#RomaniChords

🧵16/20

Our #Hackathon continued the next day.

We reconvened to review yesterday’s pilot data, polish it, and get it ready for analysis.

#RomaniChords

🧵15/20

And, of course, what would a workshop on Romani music be *without* Romani music?

We wrapped up the first evening in the “Za školou” café, where our dear guests prepared a set of Romani songs for us. The concert was opened to the public, and the venue was soon filled with a crowd of dancing people.

That brilliant concert transitioned into a fantastic jam session that lasted until the morning hours…

#RomaniChords

🧵14/20

Since the finger movement data were rather “nice to have” than those “must have,” we decided to give up this challenge and focus exclusively on the sonic data part.

In the evening, we welcomed three Romani artists, thanks to whom we were able to record some firsthand sonic data on accompanying harmonies. The session was accompanied by an insightful conversation with the musicians, allowing us to engage with the sociocultural layers of the phenomenon.

#RomaniChords

🧵13/20

We would probably fix this if we:

* Set up several controllers from different angles to overcome its blind spots (although setting this up properly would require a great deal of additional programming work).

* Combine the controller with more accurate tracking tools, such as motion-tracking gloves (although we could quickly make playing very uncomfortable for the musicians).

Any #AR and/or #VR specialist here to give us their thoughts?

#RomaniChords

🧵12/20

We experienced similar issues with the accordion.

Especially for positions when fingers were close to each other or those where the thumb was hidden under the palm, the hand slipped away from the camera’s attention very quickly.

Also, the estimated fingers’ positions were often inconsistent with the actual positions. The distance between the keyboard keys seemed too small for the camera to determine correctly which key the finger was located.

#RomaniChords

🧵11/20

However, we have not been quite successful in these ambitions.

It turns out that the left hand on the guitar fingerboard is no longer recognised by the controller, very likely because the guitar fretboard goes in the way of the camera’s frame.

In other words, we didn’t find a sweet spot where the controller could cover the fretboard while properly recognising the hand and, thus, tracking the movement of all fingers as needed.

#RomaniChords

🧵10/20

Another challenge of our Hackathon was the attempt to track #FingerMovement automatically and synchronise it with the sonic data.

We wanted to test the current state of the art using the #Ultraleap Leap Motion Controller 2 for finger tracking.

And since neither accordion nor guitar stays relatively stable while being played, we also planned to track the movement of instruments with #ARTags (aka #AprilTags).

#RomaniChords

🧵9/20

Another method we considered was the #PolyphonicDetection.

This method focuses on identifying and extracting individual notes from musical textures by analysing frequency components, onset times, and timbral features using techniques such as spectral decomposition, pitch tracking, and machine learning-based transcription methods.

#RomaniChords

🧵6/20

Nevertheless, we found the use of ACR for the #RomChords project to be limited.

ACR is a classification task that analyses audio signals to compare and categorise harmonic content into *predefined* chord labels.

While this method estimates very well the common progressions in functional harmony, it doesn’t quite know how to handle less common chords and voicings (such as the “dimenzovaný” chord” mentioned above) as they are not usually found in the *predefined* labels.

#RomaniChords

🧵5/20

Then, we discussed and tried out various contemporary music information retrieval methods with a special focus on accompanying #harmonies (aka #chords).

The first method to come up was “Automatic chord recognition” ( #ACR), a method that scientists have worked on for over 25 years.

A nice summary of this ongoing research (with the most significant challenges identified) can be found in this 5-year-old article => https://archives.ismir.net/ismir2019/paper/000004.pdf

#RomaniChords

🧵4/20

The discussion helped to identify the biggest challenges for the Hackathon:

On the one hand, the project aims to collect the data on an ambitious scale, which requires a pragmatic data-driven approach (a “musical laboratory”). But on the other, the phenomenon of Romani chords is embedded in peculiar layers of sociocultural reality, the uncovering of which requires a sensitive ethnographic approach.

This dilemma became the central theme for our methodological thoughts.

#RomaniChords

🧵3/20

The Hackathon brought together 10 scientists of different backgrounds – from linguists to music scholars and computer scientists.

To warm up intellectually,* we began with a general discussion of the phenomenon of Romani chords.

–––
*
Do you want to warm up with us to digest this thread easier? Watch the bit of the project’s video abstract from 7:17–7:58 and then try to answer the question: “Why does the dimenzovaný chord matter?”

=>

https://www.youtube.com/watch?v=aEXkI2br3cc&t=437s

#RomaniChords

🧵2/20

On 13–14th of February 2025, I organised a #Hackathon on #RomaniChords that explored various methodological avenues for my #MSCA project’s data acquisition.

Here’s a short thread summarising what we dealt with and achieved during these days.

CCying everyone interested in #Ethnomusicology, #Musicology, #ComputationalMusicology, #MusicScience, #RomaniStudies, #RomaniMusic and alike.

Let’s jump right into it!

[Note: See alt text for more info about the pictures attached to this thread]

🧵1/20