'friend' Got Mad At Me And Is Threatening Legal Action If I Dont Delete Clips That Have There Voice After The Got Upset At Me

im currently 18 and live in US California. most of the clips of my friend (lets call him bob) i recorded when we were both under 18. currently he is 17, lives in ohio is and threatening legal action if i dont remove clips i have saved of bobs voice. i have been friends with bob for a long time, this also means i have probably at least a couple hours of his voice. i never hid and even explicitly stated that i have clipping softwere and its obvious i do. my private discord server soundbored has a bunch of random things from my friends and countless times i have been asked to "clip it" from my friends. yet he is stating that he never explicitly consented to being recorded. deleting all the clips would take hours of my time and a lot of work going through each clip and looking for ones that have his voice. considering i have thousands of one minute or longer clips. could i be in legal trouble for not deleting the clips?

and how can i protect myself from legal action in the future?