Try   HackMD

Martin Howse

tags: PARTICIPANTS

martin development

27/11
Martin unable to come to taiwan due to health issues. He sent notes.
https://hackmd.io/kFejznSlT3CVr_UxDID9Zw

Martin sound notes

Day One

  • Checking lists - we need small mixer and monitor speakers
  • Making test recordings with USB microphone: I suggest as many layers as possible to uncouple all, also placed on foam on concrete floor
  • We have problem with audacity not registering signals above 20KHz - check this with baudline and there we have a nice full spectrum and can also record files…
  • Working later on Python code which might allow bugs to compose the libretto
  • We need more soundproofing

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →

Day Two

We are interested in: Sitophilus oryzae !

  • Piezo workings… trying also piezo radio transmitter - we will always have feedback issues so how to exploit these with the help of the bugs?

Day Three

TODO: test other radio transmitters, test divide down circuit

See also for downsamplimg and filtering:

https://tai-studio.org/index.php/2011/03/materials-for-tais/

some SC code to highpass and delay:

(
{
var in;
var signal;
signal = AudioIn.ar(1);
d=DelayL.ar(
HPF.ar(signal, 4000.0, 40),2,2
);
//Out.ar(0,in);

(d).dup

}.play(s)

)

Some code to generate libretto from bug energy:

# for more recent NLTK which doesn't have bm=NgramModel(2,cry) # bigram model
# this one is working!
# fixed now for python3

# python3 bug_libretto.py

# http://www.nltk.org/api/nltk.lm.html#module-nltk.lm

# you may need to apply fix here to portaudio: https://stackoverflow.com/questions/59006083/how-to-install-portaudio-on-pi-properly

# generates libretto from sound source energy of bugs

from nltk import *
from time import sleep
import math
import random
import time
#import serial
import codecs
import os
import subprocess as sp
from nltk.lm import MLE
from nltk.util import bigrams
from nltk.lm.preprocessing import padded_everygram_pipeline
import unicodedata
import struct
import numpy as np
import sounddevice as sd
from scipy.signal import butter, lfilter

def butter_bandpass(lowcut, highcut, fs, order=5):
    nyq = 0.5 * fs
    low = lowcut / nyq
    high = highcut / nyq
    b, a = butter(order, [low, high], btype='band')
    return b, a    

def butter_bandpass_filter(data, lowcut, highcut, fs, order=5):
    b, a = butter_bandpass(lowcut, highcut, fs, order=order)
    y = lfilter(b, a, data)
    return y


def convert_accents(text):
    return unicodedata.normalize('NFKD', text).encode('ascii', 'ignore')

#soundings
INTERVAL = 1
CHANNELS = 1
RATE = 48000
CHUNK = int(RATE * INTERVAL)
CHUNK=4000
sd.default.samplerate = RATE
sd.default.device = 3 # this is the mic

#letterings
#f = codecs.open("/root/projects/archived/worms_txt/chants","r","utf-8")
f = codecs.open("/root/notes_and_projectsNOW/bug/dongio","r","utf-8") # wherever you have the source text file to get letter/letter frequencies from - longer is better. here don giovanni
#f = codecs.open("/root/projects/archived/worms_txt/short")
cry = f.read()
#cry=[y.lower() for y in cry]
#cry=[convert_accents(word) for word in cry]

uf=FreqDist(l for l in cry)
up=DictionaryProbDist(uf,normalize=True)
#bm=NgramModel(2,cry) # bigram model
#lm.fit(cry, vocab)

#print list(bigrams(text[0]))
#print list(bigrams(cry))

# what we need from text is:  a text that is a list of sentences, where each sentence is a list of strings.
# eg. text = [['a', 'b', 'c'], ['a', 'c', 'd', 'c', 'e', 'f']]

sentt=[]
 
for sent in sent_tokenize(cry):
    letterss=[]
    #sentt.append(sent)
    for letters in sent:
        letterss.append(letters)
    sentt.append(letterss)
    
#print sentt
#cryyy = list(cryy)

#print cryy

train, vocab = padded_everygram_pipeline(2, sentt)
lm = MLE(2)
lm.fit(train, vocab)
#print lm.vocab 

#for prob?
#print lm.score("a",list("b"))

uf=FreqDist(l for l in cry)
up=DictionaryProbDist(uf,normalize=True)
#print uf
#bm=NgramModel(2,cry) # bigram model

#print lm.generate(5, text_seed=['c'], random_seed=3))

def genereate(dct,model,letter,n):
    probb=[]
    result=''
    total=''
    line=''
    for x in range(n):
        for l in dct.samples():
            prob=model.logscore(l,tuple(letter))
#            print prob, letter, l
            probb.append((prob,l))
        probb.sort()
        probb.reverse()
        #        print probb
        #        line = ser.read(1)
        #        line = random.randint(0,32)
        #        line=1
        # line is our line now spectral
        # problem is to overlap our chunks otherwise we have to wait so long
        data = sd.rec(CHUNK, samplerate=RATE, channels=1)
        sd.wait()
        #    y = np.frombuffer(data, dtype='b')
        y=data
        oneD_array_of_amps_of_fiveHz_component = butter_bandpass_filter(y, 500, 1000, 4000, 5)
        #calculate energy like this
        energy_of_fiveHz_comp = sum([x*2 for x in oneD_array_of_amps_of_fiveHz_component])
        nummm = int(1000.0*energy_of_fiveHz_comp)
        if nummm<0:
            nummm=2;
        if nummm>=len(probb):
            nummm=len(probb)-1;
        letter=probb[random.randint(0,int(nummm))][1]
        result=result+letter
        probb=[]
        if letter=="\n":
            return result[0:-1]
    return result[0:-1]

inpt=time.time()
#ser = serial.Serial('/dev/ttyACM0', 9600, timeout=1)
seedletter='e'

fullon=[]
count=0

#pr=lm.generate(2000) # this seems to work with our model but not our generate which lacks spaces for one thing
#print ''.join(pr)
for x in range(100):
    x=genereate(up,lm,seedletter,64) # max length of line
    print(x)

More supercollider with downsampling:

(
o = Server.default.options;
o.sampleRate=96000;
Server.default.reboot;
)

(
{
	var in;
	var bits=16; // bits=16, downsamp=2|
	var down;
	var downsamp=4;
	var signal;
	signal = AudioIn.ar(1);
	in = signal.round(0.5 ** bits);
	down = Latch.ar(
		in,
		Impulse.ar(SampleRate.ir / downsamp.max(4))
	);
	signal=blend(in, down, (downsamp - 1).clip(0, 1));
	d=DelayL.ar(
		HPF.ar(signal, 4000.0, 40),2,2
	);
	//Out.ar(0,in);

	(d).dup

}.play(s)
)

And borrowed from Fredrik LFSR with input:

(
var w, a;
w= Window("lfsr", Rect(100, 100, 520, 200)).front;
Slider(w, Rect(10, 10, 500, 25)).action_({|view| a.set(\rate, view.value*2000)}).value= 400/2000;
Slider(w, Rect(10, 40, 500, 25)).action_({|view| a.set(\length, view.value*32)}).value= 16/32;
a= {|rate= 400, iseed= 2r1000, tap1= 1, tap2= 3, tap3= 5, length= 16|
    var l, b, trig, o, signal, in;
    var buf= LocalBuf(1);
    buf.set(iseed);
    trig= Impulse.ar(rate);
    l= Demand.ar(trig, 0, Dbufrd(buf));  //read
    //b= l.bitXor(l>>tap1).bitXor(l>>tap2).bitXor(l>>tap3)&1;  //modify
	signal = AudioIn.ar(1);
	in = signal.round(0.5 ** 8);
	//b= l.bitXor(l>>tap1).bitXor(l>>tap2).bitXor(l>>tap3).bitXor(in)&1;  //modify
	b= (in)&1;  //modify

	l= (l>>1)|(b<<(length-1));  //lfsr
    Demand.ar(trig, 0, Dbufwr(l, buf));  //write
    o= PulseCount.ar(Impulse.ar(rate*length), trig);  //bits
    l>>o&1!2;  //output
}.play;
CmdPeriod.doOnce({w.close});

Day Four

Streaming in for performance - I use remote jitsii stream from ricebugs in remote/quieter location with supercollider (code is more or less above with addition of sliders for volume and high pass frequency).

Using pulseaudio (pulseaudio -vvv) and qjackctl with extra configuration in qjackctl - and then work with the routing of the pulseaudio sink and source

https://www.celesteh.com/blog/tag/supercollider/

Day Five

Flying bugs!

Setup of remote stream (icecast?) from isolated bug location with USB microphone - also spectral capture.

mplayer -nocache http://example.org:8000/node1 -> qjackctl -> sc

Approaches

Acts/ideas

arecord -D hw:0

  • Sampling and downsampling: mic->highpass->downsample - supercollider

Technical

  • USB ultrasonic microphone and raspberry pi4 (software based)
  • Ultrasonic MEMS microphones and downconvertor - audible signals
  • Ultrasonic MEMS microphones and amplifier sampled by pi4 and audio codec - Raspberry Pi Shield - HiFiBerry DAC+ ADC Pro
  • Radio transmission from vibrations from the bugs
  • Audio communication to the bugs (pi based with small amplifier and Taro speakers)

Notes: vibration damping from below, protection of sensitive mics from moisture/humidity, dealing with ultrasonic signals.

Platform: pd, sc or custom…

https://github.com/redFrik/supercolliderStandaloneRPI2

Experiments

  • how to capture and visualise spectrum of bug activity?

https://www.baudline.com/download.html

spectogram view (for track) in audacity

sox sound.wav -n spectrogram (generates png)

python and matplotlib

https://medium.com/quick-code/python-audio-spectrum-analyser-6a3c54ad950

freqscope for sc: https://doc.sccode.org/Classes/FreqScope.html

  • install software for audio on pi - supercollider and jackd are installed, needs puredata or other platform
  • capture and playback ultrasonic audio from bugs (pi and/or laptop), examine feedback and vibration
  • generate high frequency signals from GPIO on pi and interface with speakers

USB microphone

Ultramic UM192K (https://www.dodotronic.com/product/ultramic-um192k/?v=2a47ad90f2ae

Notes - the end has a cap and when removed will need to be protected from moisture/humidity without impacting too much one sensitivity. Same for all microphone elements.

MEMS microphones and downconversion

Bug FM transmitters around 100 MHz

The design has changed a bit - it can be cut on copper foil using a vinyl cutter and easily assembled. Very sensitive to vibration. Tune receiver on FM to 98-105MHz.

I was also thinking some rice could be sprayed with metal copper and this could interfere with the transmission. Needs to be experimented with.

PI4 and HiFiBerry DAC+ ADC Pro audio shield

1 Analogue input, phone jack 3.5mm
2 Analogue output RCA
3 Analogue output (p5)
4 Input configuration jumper (J1)
5 Alternative input connector (P6)

https://www.hifiberry.com/docs/data-sheets/datasheet-dac-adc/

Shipping/ordering

Shipping list:

  • USB ultrasonic microphone: https://www.dodotronic.com/product/ultramic-um192k/?v=2a47ad90f2ae
  • Raspberry PI4 + 16GB sdcard (with pi os installed and audio configured) + power supply (EU plug) + HiFiBerry DAC+ ADC Pro audio shield
  • 2x MEMs microphones: one with downconversion to audible range and 1 with amplifiers for sampling with pi4+ADC (there were 3 but one didn't work - they are very cheap)
  • 4x printed radio transmitters
  • 1x piezo radio transmitter
  • some electronic parts for making amplifiers and transmitters

Shopping list:

similar product in Taiwan

電子材料行

  • audio cables (1.5meters plus):

電子材料行

電子材料行

電子材料行

SparkFun MEMS Microphone Breakout – INMP401 (ADMP401) 麥克風感測器模組

  • basic electronic parts: 2xMCP6002 amplifier (DIP), breadboard, 10x 100k resistors, wire, jumpers

電子材料行

  • Raspberry PI3 + 16GB microSD card + 5v 2.5A power supply with MICRO-USB connector for PI.
  • 2x FM/AM radio recievers like:

電子材料行

  • 4x 9v batteries, 2x AAA batteries

電子材料行

Last changed by 
 
LKL-Riceacademy (米學院之米蟲革命)
0
1
834

Read more

TEST PERFORMANCE

December 20 start ultrasonic microphone streaming leaving microphone with bugs in small white house test-performance 1 - December 17, 2020 test performance youtube bugs and sensor set up

Dec 21, 2020
米學院之米蟲革命

RICE ACADEMY Rice Bug Revolt Overview Proposal Lab Notes Documentation Schedule Design 3D Electronic Tech Meeting Notes

Dec 19, 2020
FABRICATION

12/12 First Assemble in the Lab 09/12 First Farbrication &amp; Assemble 08/12 Sktech 24/11 3D Sketch Unit: mm L: 830, W: 530, H: 580

Dec 16, 2020
Proposal

&#x300A;&#x7C73;&#x5B78;&#x9662;&#x300B;&#x57F9;&#x990A;&#x3001;&#x7814;&#x7A76;&#x4E26;&#x57F9;&#x80B2;&#x7C73;&#x87F2;&#xFF0C;&#x4EE5;&#x7B56;&#x52D5;&#x7C73;&#x87F2;&#x9769;&#x547D;&#x3002;&#x7C73;&#x5B78;&#x9662;&#x65E8;&#x5728;&#x7814;&#x7A76;&#x5982;&#x4F55;&#x8B93;&#x9019;&#x4E9B;&#x96B1;&#x5F62;&#x7684;&#x4EE3;&#x7406;&#x4EBA;&#x767C;&#x8072;&#xFF0C;&#x4EE5;&#x914D;&#x6709;&#x8D85;&#x8072;&#x6CE2;&#x9EA5;&#x514B;&#x98A8;&#xFF0C;&#x7121;&#x7DDA;&#x96FB;&#x767C;&#x9001;&#x5668;&#xFF0C;&#x50B3;&#x611F;&#x5668;&#x548C;&#x7D2B;&#x5916;&#x7DDA;&#x71C8;&#x7684;&#x990A;&#x87F2;&#x5BB9;&#x5668;&#x63D0;&#x51FA;&#x4E00;&#x7CFB;&#x5217;&#x96C6;&#x9AD4;&#x884C;&#x52D5;&#x7684;&#x88DD;&#x7F6E;&#x548C;&#x5100;&#x5668;. &#x501F;&#x9451;&#x63A7;&#x7BA1;&#x8FB2;&#x696D;&#x5BB3;&#x87F2;&#x7684;&#x79D1;&#x6280;&#x53CA;&#x63A7;&#x5236;&#x7CFB;&#x7D71;&#xFF0C;&#x6AA2;&#x67E5;&#x9AD8;&#x983B;&#x7684;&#x8F3E;&#x58D3;&#x8072;&#x548C;&#x4F4E;&#x983B;&#x7387;&#x7684;&#x6EAB;&#x5EA6;&#x8B8A;&#x5316;&#xFF0C;&#x4F86;&#x523A;&#x6FC0;&#x6D3B;&#x8E8D;&#x7684;&#x7C73;&#x87F2;&#x9769;&#x547D;, &#x4EE5;&#x5176;&#x653E;&#x9001;&#x51FA;&#x7684;&#x566A;&#x97F3;&#x518D;&#x884D;&#x751F;&#x9769;&#x547D;&#x6B4C;&#x5287;&#x7C21;&#x8B5C;. &#x7C73;&#x5B78;&#x9662;&#x6210;&#x54E1;&#xFF1A;&#x8CF4;&#x660E;&#x4FE1;&#xFF08;&#x884C;&#x653F;&#x9662;&#x8FB2;&#x696D;&#x59D4;&#x54E1;&#x6703;&#x8FB2;&#x696D;&#x8A66;&#x9A57;&#x6240;&#x4F5C;&#x7269;&#x7D44;&#x7814;&#x7A76;&#x54E1;&#x66A8;&#x7814;&#x7A76;&#x5BA4;&#x4E3B;&#x6301;&#x4EBA;&#xFF09;&#x3001;&#x59DA;&#x7F8E;&#x5409;&#xFF08;&#x884C;&#x653F;&#x9662;&#x8FB2;&#x696D;&#x59D4;&#x54E1;&#x6703;&#x8FB2;&#x696D;&#x8A66;&#x9A57;&#x6240;&#x61C9;&#x7528;&#x52D5;&#x7269;&#x7D44;&#x526F;&#x7814;&#x7A76;&#x54E1;&#xFF09;&#x3001;&#x6881;&#x6B63;&#x8CE2;&#xFF08;&#x6C60;&#x4E0A;&#x591A;&#x529B;&#x7C73;&#x80A1;&#x4EFD;&#x6709;&#x9650;&#x516C;&#x53F8;), &#x8CF4;&#x8E8D;&#x4EC1;&#x202D;(&#x202C;&#x5927;&#x540C;&#x5927;&#x5B78;&#x6A5F;&#x68B0;&#x5DE5;&#x7A0B;&#x5B78;&#x7CFB;&#x52A9;&#x7406;&#x6559;&#x6388;&#x202D;)&#x202C;&#x3001;&#x937E;&#x6E6B;&#x6D64;&#x202D; &#x202C;&#xFF08;&#x5927;&#x540C;&#x5927;&#x5B78;&#x6A5F;&#x68B0;&#x5DE5;&#x7A0B;&#x5B78;&#x7CFB;)&#x3001;&#x912D;&#x5148;&#x55BB; (&#x85DD;&#x8853;&#x5BB6;&#x517C;&#x8EDF;&#x9AD4;&#x958B;&#x767C;&#x8005;), &#x300C;&#x83CC;&#x7D72;&#x7DB2;&#x7D61;&#x793E;&#x6703;&#x300D;&#x202D;&#x202C;&#x85DD;&#x8853;&#x5BB6;&#xFF1A;&#x5F17;&#x6717;&#x8332;&#xFF0E;&#x85A9;&#x97CB;&#x723E;&#x202D; , &#x592A;&#x90CE;, &#x99AC;&#x4E01;&#xFF0E;&#x8C6A;&#x65AF;&#x202D; &#x202C;&#x3001;&#x912D;&#x6DD1;&#x9E97;&#x202D; .&#x202C; RICE ACADEMY cultures, studies and cultivates rice bugs towards the RICE BUG REVOLT. The ACADEMY examines ways of making audible these hidden agents, proposing a series of installations and instruments for collective actions with breakout containers furnished with ultrasonic microphone, radio transmitters, sensors and UV lights. We borrow techniques from the sciences of management and system control of harmful agricultural insects, checking out high frequency crunchings and low frequency temperature changes, encouraging the inner dynamic revolt amplified in operatic notation. RICE ACADEMY members: Ming-Hsin Lai (Senior Agronomist and Rice Lab Principle Investigator, Crop Science Division, Taiwan Agricultural Research Institute, COA),&#xA0; Me-Chi Yao(Associate Researcher, Applied Zoology Division, Taiwan Agricultural Research Institute, COA), Cheng-Hsien Liang (Chih Shang Duo-Li Rice Co., Ltd), Yao-Jen LAI and Chiu-Hung Chung (Department of Mechanical Engineering,Tatung University) , artist/software developer Hsien Yu Cheng and Mycelium Network Society artists (Franz Xaver, taro, Martin House, Shu Lea Cheang).

Dec 10, 2020
Read more from LKL-Riceacademy (米學院之米蟲革命)
Published on HackMD