mirror of
https://github.com/LMMS/lmms.git
synced 2026-01-01 19:18:07 -05:00
* Remove the struct StereoSample Remove the struct `StereoSample`. Let `AudioEngine::getPeakValues` return a `sampleFrame` instead. Adjust the calls in `Mixer` and `Oscilloscope`. * Simplify AudioEngine::getPeakValues * Remove surroundSampleFrame Some code assumes that `surroundSampleFrame` is interchangeable with `sampleFrame`. Thus, if the line `#define LMMS_DISABLE_SURROUND` is commented out in `lmms_basics.h` then the code does not compile anymore because `surroundSampleFrame` now is defined to be an array with four values instead of two. There also does not seem to be any support for surround sound (four channels instead of two) in the application. The faders and mixers do not seem to support more that two channels and the instruments and effects all expect a `sampleFrame`, i.e. stereo channels. It therefore makes sense to remove the "feature" because it also hinders the improvement of `sampleFrame`, e.g. by making it a class with some convenience methods that act on `sampleFrame` instances. All occurrences of `surroundSampleFrame` are replaced with `sampleFrame`. The version of `BufferManager::clear` that takes a `surroundSampleFrame` is removed completely. The define `SURROUND_CHANNELS` is removed. All its occurrences are replaced with `DEFAULT_CHANNELS`. Most of the audio devices classes, i.e. classes that inherit from `AudioDevice`, now clamp the configuration parameter between two values of `DEFAULT_CHANNELS`. This can be improved/streamlined later. `BYTES_PER_SURROUND_FRAME` has been removed as it was not used anywhere anyway. * Make sampleFrame a class Make `sampleFrame` a class with several convenience methods. As a first step and demonstration adjust the follow methods to make use of the new functionality: * `AudioEngine::getPeakValues`: Much more concise now. * `lmms::MixHelpers::sanitize`: Better structure, better readable, less dereferencing and juggling with indices. * `AddOp`, `AddMultipliedOp`, `multiply`: Make use of operators. Might become superfluous in the future. * More operators and methods for sampleFrame Add some more operators and methods to `sampleFrame`: * Constructor which initializes both channels from a single sample value * Assignment operator from a single sample value * Addition/multiplication operators * Scalar product Adjust some more plugins to the new functionality of `sampleFrame`. * Adjust DelayEffect to methods in sampleFrame * Use composition instead of inheritance Using inheritance was the quickest way to enable adding methods to `sampleFrame` without having to reimpement much of `std::array`s interface. This is changed with this commit. The array is now a member of `sampleFrame` and the interface is extended with the necessary methods `data` and the index operator. An `average` method was added so that no iterators need to be implemented (see changes in `SampleWaveform.cpp`). * Apply suggestions from code review Apply Veratil's suggestions from the code review Co-authored-by: Kevin Zander <veratil@gmail.com> * Fix warnings: zeroing non-trivial type Fix several warnings of the following form: Warnung: »void* memset(void*, int, size_t)« Säubern eines Objekts von nichttrivialem Typ »class lmms::sampleFrame«; use assignment or value-initialization instead [-Wclass-memaccess] * Remove unnecessary reinterpret_casts Remove some unnecessary reinterpret_casts with regards to `sampleFrame` buffers. `PlayHandle::m_playHandleBuffer` already is a `sampleFrame*` and does not need a reinterpret_cast anymore. In `LadspaEffect::processAudioBuffer` the `QVarLengthArray` is now directly initialized as an array of `sampleFrame` instances. I guess in both places the `sampleFrame` previously was a `surroundSampleFrame` which has been removed. * Clean up zeroSampleFrames code * Fix warnings in RemotePlugin Fix some warnings related to calls to `memcpy` in conjunction with`sampleFrame` which is now a class. Add the helper functions `copyToSampleFrames` and `copyFromSampleFrames` and use them. The first function copies data from a `float` buffer into a `sampleFrame` buffer and the second copies vice versa. * Rename "sampleFrame" to "SampleFrame" Uppercase the name of `sampleFrame` so that it uses UpperCamelCase convention. * Move SampleFrame into its own file Move the class `SampleFrame` into its own class and remove it from `lmms_basics.h`. Add forward includes to all headers where possible or include the `SampleFrame` header if it's not just referenced but used. Add include to all cpp files where necessary. It's a bit surprising that the `SampleFrame` header does not need to be included much more often in the implementation/cpp files. This is an indicator that it seems to be included via an include chain that at one point includes one of the headers where an include instead of a forward declaration had to be added in this commit. * Return reference for += and *= Return a reference for the compound assignment operators `+=` and `-=`. * Explicit float constructor Make the constructor that takes a `float` explicit. Remove the assignment operator that takes a `float`. Clients must use the explicit `float` constructor and assign the result. Adjust the code in "BitInvader" accordingly. * Use std::fill in zeroSampleFrames * Use zeroSampleFrames in sanitize * Replace max with absMax Replace `SampleFrame::max` with `SampleFrame::absMax`. Use `absMax` in `DelayEffect::processAudioBuffer`. This should also fix a buggy implementation of the peak computation. Add the function `getAbsPeakValues`. It computes the absolute peak values for a buffer. Remove `AudioEngine::getPeakValues`. It's not really the business of the audio engine. Let `Mixer` and `Oscilloscope` use `getAbsPeakValues`. * Replace scalarProduct Replace the rather mathematical method `scalarProduct` with `sumOfSquaredAmplitudes`. It was always called on itself anyway. * Remove comment/TODO * Simplify sanitize Simplify the `sanitize` function by getting rid of the `bool found` and by zeroing the buffer as soon as a problem is found. * Put pointer symbols next to type * Code review adjustments * Remove "#pragme once" * Adjust name of include guard * Remove superfluous includes (leftovers from previous code changes) --------- Co-authored-by: Kevin Zander <veratil@gmail.com>
173 lines
6.4 KiB
C++
173 lines
6.4 KiB
C++
/* SaProcessor.h - declaration of SaProcessor class.
|
|
*
|
|
* Copyright (c) 2019 Martin Pavelek <he29/dot/HS/at/gmail/dot/com>
|
|
*
|
|
* Based partially on Eq plugin code,
|
|
* Copyright (c) 2014 David French <dave/dot/french3/at/googlemail/dot/com>
|
|
*
|
|
* This file is part of LMMS - https://lmms.io
|
|
*
|
|
* This program is free software; you can redistribute it and/or
|
|
* modify it under the terms of the GNU General Public
|
|
* License as published by the Free Software Foundation; either
|
|
* version 2 of the License, or (at your option) any later version.
|
|
*
|
|
* This program is distributed in the hope that it will be useful,
|
|
* but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
|
* General Public License for more details.
|
|
*
|
|
* You should have received a copy of the GNU General Public
|
|
* License along with this program (see COPYING); if not, write to the
|
|
* Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor,
|
|
* Boston, MA 02110-1301 USA.
|
|
*
|
|
*/
|
|
|
|
#ifndef SAPROCESSOR_H
|
|
#define SAPROCESSOR_H
|
|
|
|
#include <atomic>
|
|
#include <fftw3.h>
|
|
#include <QMutex>
|
|
#include <QRgb>
|
|
#include <vector>
|
|
|
|
#include "lmms_basics.h"
|
|
|
|
|
|
namespace lmms
|
|
{
|
|
|
|
template<class T>
|
|
class LocklessRingBuffer;
|
|
|
|
class SaControls;
|
|
class SampleFrame;
|
|
|
|
|
|
//! Receives audio data, runs FFT analysis and stores the result.
|
|
class SaProcessor
|
|
{
|
|
public:
|
|
explicit SaProcessor(const SaControls *controls);
|
|
virtual ~SaProcessor();
|
|
|
|
// analysis thread and a method to terminate it
|
|
void analyze(LocklessRingBuffer<SampleFrame> &ring_buffer);
|
|
void terminate() {m_terminate = true;}
|
|
|
|
// inform processor if any processing is actually required
|
|
void setSpectrumActive(bool active);
|
|
void setWaterfallActive(bool active);
|
|
void flipRequest() {m_flipRequest = true;} // request refresh of history buffer
|
|
|
|
// configuration is taken from models in SaControls; some changes require
|
|
// an exlicit update request (reallocation and window rebuild)
|
|
void reallocateBuffers();
|
|
void rebuildWindow();
|
|
void clear();
|
|
void clearHistory();
|
|
|
|
const float *getSpectrumL() const {return m_normSpectrumL.data();}
|
|
const float *getSpectrumR() const {return m_normSpectrumR.data();}
|
|
const uchar *getHistory() const {return m_history.data();}
|
|
|
|
// information about results and unit conversion helpers
|
|
unsigned int inBlockSize() const {return m_inBlockSize;}
|
|
unsigned int binCount() const; //!< size of output (frequency domain) data block
|
|
bool spectrumNotEmpty(); //!< check if result buffers contain any non-zero values
|
|
|
|
unsigned int waterfallWidth() const; //!< binCount value capped at 3840 (for display)
|
|
unsigned int waterfallHeight() const {return m_waterfallHeight;}
|
|
bool waterfallNotEmpty() const {return m_waterfallNotEmpty;}
|
|
|
|
float binToFreq(unsigned int bin_index) const;
|
|
float binBandwidth() const;
|
|
|
|
float freqToXPixel(float frequency, unsigned int width) const;
|
|
float xPixelToFreq(float x, unsigned int width) const;
|
|
|
|
float ampToYPixel(float amplitude, unsigned int height) const;
|
|
float yPixelToAmp(float y, unsigned int height) const;
|
|
|
|
unsigned int getSampleRate() const;
|
|
float getNyquistFreq() const;
|
|
|
|
float getFreqRangeMin(bool linear = false) const;
|
|
float getFreqRangeMax() const;
|
|
float getAmpRangeMin(bool linear = false) const;
|
|
float getAmpRangeMax() const;
|
|
|
|
// Reallocation lock prevents the processor from changing size of its buffers.
|
|
// It is used to keep consistent bin-to-frequency mapping while drawing the
|
|
// spectrum and to make sure reading side does not find itself out of bounds.
|
|
// The processor is meanwhile free to work on another block.
|
|
QMutex m_reallocationAccess;
|
|
// Data access lock prevents the processor from changing both size and content
|
|
// of its buffers. It is used when writing to a result buffer, or when a friendly
|
|
// class reads them and needs guaranteed data consistency.
|
|
// It causes FFT analysis to be paused, so this lock should be used sparingly.
|
|
// If using both locks at the same time, reallocation lock MUST be acquired first.
|
|
QMutex m_dataAccess;
|
|
|
|
|
|
private:
|
|
const SaControls *m_controls;
|
|
|
|
// thread communication and control
|
|
bool m_terminate;
|
|
|
|
// currently valid configuration
|
|
unsigned int m_zeroPadFactor = 2; //!< use n-steps bigger FFT for given block size
|
|
std::atomic<unsigned int> m_inBlockSize;//!< size of input (time domain) data block
|
|
unsigned int m_fftBlockSize; //!< size of padded block for FFT processing
|
|
unsigned int m_sampleRate;
|
|
|
|
// data buffers (roughly in the order of processing, from input to output)
|
|
unsigned int m_framesFilledUp;
|
|
std::vector<float> m_bufferL; //!< time domain samples (left)
|
|
std::vector<float> m_bufferR; //!< time domain samples (right)
|
|
std::vector<float> m_fftWindow; //!< precomputed window function coefficients
|
|
std::vector<float> m_filteredBufferL; //!< time domain samples with window function applied (left)
|
|
std::vector<float> m_filteredBufferR; //!< time domain samples with window function applied (right)
|
|
fftwf_plan m_fftPlanL;
|
|
fftwf_plan m_fftPlanR;
|
|
fftwf_complex *m_spectrumL; //!< frequency domain samples (complex) (left)
|
|
fftwf_complex *m_spectrumR; //!< frequency domain samples (complex) (right)
|
|
std::vector<float> m_absSpectrumL; //!< frequency domain samples (absolute) (left)
|
|
std::vector<float> m_absSpectrumR; //!< frequency domain samples (absolute) (right)
|
|
std::vector<float> m_normSpectrumL; //!< frequency domain samples (normalized) (left)
|
|
std::vector<float> m_normSpectrumR; //!< frequency domain samples (normalized) (right)
|
|
|
|
// spectrum history for waterfall: new normSpectrum lines are added on top
|
|
std::vector<uchar> m_history_work; //!< local history buffer for render
|
|
std::vector<uchar> m_history; //!< public buffer for reading
|
|
bool m_flipRequest; //!< update public buffer only when requested
|
|
std::atomic<unsigned int> m_waterfallHeight; //!< number of stored lines in history buffer
|
|
// Note: high values may make it harder to see transients.
|
|
const unsigned int m_waterfallMaxWidth = 3840;
|
|
|
|
// book keeping
|
|
bool m_spectrumActive;
|
|
bool m_waterfallActive;
|
|
std::atomic<unsigned int> m_waterfallNotEmpty; //!< number of lines remaining visible on display
|
|
bool m_reallocating;
|
|
|
|
// merge L and R channels and apply gamma correction to make a spectrogram pixel
|
|
QRgb makePixel(float left, float right) const;
|
|
|
|
#ifdef SA_DEBUG
|
|
unsigned int m_last_dump_time;
|
|
unsigned int m_dump_count;
|
|
float m_sum_execution;
|
|
float m_max_execution;
|
|
#endif
|
|
};
|
|
|
|
|
|
} // namespace lmms
|
|
|
|
#endif // SAPROCESSOR_H
|
|
|