Project : SYNCRO
One day I was need to purchase equipment that would allow me to control the screens in the hall and moving heads on the ceiling to music. I was looking for such a device, but I couldn't find it. What I found was either only for video or for moving heads and all this was not of high quality. Then I decided to develop and assemble such a device myself, as I am a microelectronics engineer and programmer in C++. For more than a year I have been developing this device, five different versions were collected and eventually a stable copy was obtained and tested. This turned out to be a device that can replace for musician of many people who were needed to control light and video effects. The device uses the most modern technologies in sound visualization. This is not just a device, it is a specialized computer system with artificial intelligence with the possibility of training for the purpose of dynamic recognition of music samples and automatic visualization using images and lighting devices using the DMX protocol. The device can work both in fully automatic mode and in the mode of playback of already recorded videos and light compositions tied to certain songs (concert mode is necessary for those who perform on stage). The name of the device is Syncro.
​
Introducing "Syncro" - a groundbreaking device that transforms the way we experience music by merging captivating visualizations with dynamic light control through the DMX interface. The name "Syncro" embodies its core attributes: Sound, Yield, Harmony, Tempo, and Mix.
Powered by a sophisticated multi-processor system, Syncro ensures unparalleled performance and responsiveness to sound. Featuring a diverse range of processors including a quad-core ARM processor, dual-core processors, a hexa-core ARM processor, and an NVIDIA GPU equipped with 1000 CUDA cores and 32 tensor cores, Syncro leverages cutting-edge technology to seamlessly integrate artificial intelligence for innovative sound-to-image and light conversion capabilities.
With its graphics core delivering over 100 TOPS performance, Syncro empowers users to craft intricate and immersive 3D dynamic images with a stunning refresh rate of up to 120fps. This visionary device represents the pinnacle of audiovisual innovation, offering unmatched sound visualization quality through the synergy of artificial intelligence and high-performance computing systems.
​
In next video, one of the next operating modes of our device will demonstrated. In this mode, images on the screen dynamically change with a color carrier replacement synchronized to the music based on selected signal frequencies. Artificial intelligence is used to analyze the frequency spectrum of the audio signal and make decisions to control the lighting fixtures via the DMX interface. In this case, we are using the CHAUVET SR-140 moving heads by Chauvet Lighting, which we believe are among the most advanced devices in the world. In the upcoming videos, we will showcase two more operating modes with videos and shaders, which require very high computational power. We will also demonstrate the so-called concert mode of operation.
In this video, the following upgrade of our device is demonstrated: an enhanced user interface, an expanded to 48 frequency graphic equalizer, showcasing shader work in automatic mode, and operation with moving heads using trainable artificial intelligence. Now our device can process any high-complexity photos, videos, and vector graphics. The 48-band equalizer now allows artificial intelligence to have a full representation of the incoming sound, enabling it to react more accurately to events.
In this video we present a completely redesigned project of the fourth generation:
1. A new DMX controller of our own production has been added, which makes it possible to control three independent DMX512 channels; with additional multiplexing, the number of channels can easily be increased to 72 and can provide up to 36864 control channels. The new DMX controller is already an independent computer in itself and can provide: a. direct data transfer b. storage of fixtures and their prompt output to channels c. shader! control is a new term and it means direct control of each DMX device by the controller using a separate program (shader) in real time and according to the coordinates of the room. The control computer only transmits current data about the music and the controller itself makes a decision about this or that action.
2. The FFT mechanism has been improved, accelerated by 400%, which is very important for synchronization.
3. the kick drum has been isolated from the general sound at the hardware level for better synchronization.
4. New systems for regulating interaction with music and device response have been introduced.
5. A completely new control and setup interface has been introduced, which made it possible to develop control algorithms without the use of additional equipment and software, directly on the device.
What will happen next:
1. Using artificial intelligence by the DMX controller for higher-quality visualization using a cameras system for feedback, in other words, the controller itself will see what it is doing and make timely adjustments.
2. The development of a smart watch for this device is already at the last stage, which will allow remote control of the system from the watch screen, and also due to the position sensor, accelerometer, it will be possible to control effects using certain hand movements - using gestures.
3. The development of a speech recognition controller is ongoing for artificial intelligence to understand the context of a song and decide on the use of visualization methods for this.
4. At the moment, we are developing an addition to the DMX protocol, which will make control of devices smoother and more predictable, and will also be able to expand the number of devices per channel. This will be possible due to the use of vector control over a single high-frequency channel. There will be no need to program the devices, just plug and play, SYNCRO will find and configure everything on its own, and also select the necessary fixtures according to the room configuration.
5. For the new protocol, we are preparing new moving heads, the efficiency and quality of which will be much better than those offered now, due to the moral obsolescence of the DMX protocol.
So, our device will support both the new protocol and the old one, but when using lighting devices with the new protocol, the number of devices will increase, the labor intensity of installation will be reduced to the minimum possible (insert the wire into the socket), the dynamic characteristics and capabilities will become much wider, the control switches to sign language, artificial intelligence listens to the song and makes a decision on the attack speed, rhythm, color, and so on.
This device is a completely new understanding of sound visualization, it is a smart and modern approach to the problem of visual effects in music and more.
We continue to do our work and prepare our device for production on an industrial scale and are looking for an investor.
Our contact: info@uoigroup.org