Let's see how you ABX!

Cpyder
Cpyder Posts: 514
edited August 2009 in 2 Channel Audio
So, I've been running some ABX testing on various types of music using Foobar. I'm sort of working my way up to telling the difference between lossless and 320kbps. 128 vs. flac is a joke. 192 vs. flac gets a little trickier but there are definite differences. If I'm not in a listening mood, I usually don't do much better than guessing. When I actually sit down and spend some time, it gets easier.

I've found that at higher compressions, you can sometimes tell a difference but are unsure which recording is which. They both sound good and very listenable.

How good are all of you? I'd like to see some uploads of ABX testing results showing how high of compression vs. lossless you can determine. Let's try to keep the probability of guessing pretty low. Say 10/12?

Also, what are some of your techniques? I know for lower compressions, the higher frequencies are a dead giveaway. And on medium compression, you can sometimes tell a difference in the sound stage. But for full 320kbps AAC vs. Flac, what are some of your ways of determining which is which?

Let's hear some feedback and see some results!

I'd love to see someone ace a 320 vs. lossless ABX test. It's WAY harder than I thought. 320 really isn't THAT bad, even for serious listening.
Post edited by Cpyder on

Comments

  • Airplay355
    Airplay355 Posts: 4,298
    edited August 2009
    Dynamic range is also a give away for me. More compression=much less of a range in a recording that I normally find dynamic. The bass also becomes sloppier at lower volumes with compression. Deep bass stays tight in an uncompressed format even when I crank it.
  • TNRabbit
    TNRabbit Posts: 2,168
    edited August 2009
    Depends DIRECTLY on the abilities of your system/setup.

    And your EARS, of course....
    TNRabbit
    NO Polk Audio Equipment :eek:
    Sunfire TG-IV
    Ashly 1001 Active Crossover
    Rane PEQ-15 Parametric Equalizers x 2
    Sunfire Cinema Grand Signature Seven
    Carver AL-III Speakers
    Klipsch RT-12d Subwoofer
  • BlueFox
    BlueFox Posts: 15,251
    edited August 2009
    I use lossless compression, so there is no difference between compressed and uncompressed sound.
    Lumin X1 file player, Westminster Labs interconnect cable
    Sony XA-5400ES SACD; Pass XP-22 pre; X600.5 amps
    Magico S5 MKII Mcast Rose speakers; SPOD spikes

    Shunyata Triton v3/Typhon QR on source, Denali 2000 (2) on amps
    Shunyata Sigma XLR analog ICs, Sigma speaker cables
    Shunyata Sigma HC (2), Sigma Analog, Sigma Digital, Z Anaconda (3) power cables

    Mapleshade Samson V.3 four shelf solid maple rack, Micropoint brass footers
    Three 20 amp circuits.
  • Ender
    Ender Posts: 603
    edited August 2009
    I follow Airplay's method. Also, you have to choose the right music. There are alot of songs out there that don't have wide complex frequency passages. When you try to differentiate quality of encoding on a song that only has a few guitar chords and drum bass that doesn't go extend very deep, then you're kinda screwed on trying to figure out differences between speakers, much less encoding.
    SDA 1C, SDA 2A, SDA SRS 2, CMT-340SE, Swan M200MKII, Swan D1080MKII, Behringer MS40

    Outlaw Audio M2200 x2, GFA 555 II, BGW 750C

    GDA 700, Outlaw Audio Model 990, Sansa Fuze, X-Fi Platinum Fatality
  • heiney9
    heiney9 Posts: 25,165
    edited August 2009
    MP3's suck for any kind of true audiophile system. End of story!!!!
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Pangea AC14SE MKII | Legend L600 | BlueSound Node 3 - Tubes add soul!
  • ESavinon
    ESavinon Posts: 3,066
    edited August 2009
    heiney9 wrote: »
    MP3's suck for any kind of true audiophile system. End of story!!!!

    +1.
    I can hear differences between wav and lossless.
    SRT For Life; SDA Forever!

    The SRT SEISMIC System:
    Four main satellite speakers, six powered subs, two dedicated for LFE channel, two center speakers for over/under screen placement and three Control Centers. Amaze your friends, terrorize your neighbors, seize the audio bragging rights for your state. Go ahead, buy it; you only go around once.
  • Cpyder
    Cpyder Posts: 514
    edited August 2009
    ESavinon wrote: »
    +1.
    I can hear differences between wav and lossless.

    I think you may have something wrong with you if you are telling the difference between wav and lossless. LOL I think you mean lossy.

    But no, I'd like to see someone pass lossless vs. 320 and upload the results. It's no laughing matter. Really. I find it damn near impossible. Maybe I'm using the wrong type of music but it's definitely not my systems fault.
  • Cpyder
    Cpyder Posts: 514
    edited August 2009
    heiney9 wrote: »
    MP3's suck for any kind of true audiophile system. End of story!!!!

    Upload some 320 vs. lossless results and then make the statement again. I don't disagree, and where I can, all of my music is lossless but I still have a fair amount of lossy music.
  • heiney9
    heiney9 Posts: 25,165
    edited August 2009
    Cpyder wrote: »
    Upload some 320 vs. lossless results and then make the statement again. I don't disagree, and where I can, all of my music is lossless but I still have a fair amount of lossy music.

    I have and I stand by my statement.

    But, like you I do have some lossy material that I use for background music, casual listening, etc., as well as using Comcast's Music Choice channels, which are very lossy streaming files, to discover new music.

    But I don;t use my main rig or do any serious listening with any type of lossy files. Hence my original statement.
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Pangea AC14SE MKII | Legend L600 | BlueSound Node 3 - Tubes add soul!
  • unc2701
    unc2701 Posts: 3,587
    edited August 2009
    So if I ripped a wav and 320 mp3, then converted the 320mp3 to a wav and uploaded both, you'd be able to tell which was which?
    Gallo Ref 3.1 : Bryston 4b SST : Musical fidelity CD Pre : VPI HW-19
    Gallo Ref AV, Frankengallo Ref 3, LC60i : Bryston 9b SST : Meridian 565
    Jordan JX92s : MF X-T100 : Xray v8
    Backburner:Krell KAV-300i
  • tonyb
    tonyb Posts: 32,966
    edited August 2009
    I don't do digital downloads,I prefer concerts,live music,where the drums hit you in the chest,the women are half naked,and the beer is luke warm.Try down loading that.Rock on.
    HT SYSTEM-
    Sony 850c 4k
    Pioneer elite vhx 21
    Sony 4k BRP
    SVS SB-2000
    Polk Sig. 20's
    Polk FX500 surrounds

    Cables-
    Acoustic zen Satori speaker cables
    Acoustic zen Matrix 2 IC's
    Wireworld eclipse 7 ic's
    Audio metallurgy ga-o digital cable

    Kitchen

    Sonos zp90
    Grant Fidelity tube dac
    B&k 1420
    lsi 9's
  • BlueFox
    BlueFox Posts: 15,251
    edited August 2009
    unc2701 wrote: »
    So if I ripped a wav and 320 mp3, then converted the 320mp3 to a wav and uploaded both, you'd be able to tell which was which?


    Of course. Just because a lossy file is re-encoded in WAV does not mean it has any more data than it did as an MP3.
    Lumin X1 file player, Westminster Labs interconnect cable
    Sony XA-5400ES SACD; Pass XP-22 pre; X600.5 amps
    Magico S5 MKII Mcast Rose speakers; SPOD spikes

    Shunyata Triton v3/Typhon QR on source, Denali 2000 (2) on amps
    Shunyata Sigma XLR analog ICs, Sigma speaker cables
    Shunyata Sigma HC (2), Sigma Analog, Sigma Digital, Z Anaconda (3) power cables

    Mapleshade Samson V.3 four shelf solid maple rack, Micropoint brass footers
    Three 20 amp circuits.
  • Cpyder
    Cpyder Posts: 514
    edited August 2009
    BlueFox wrote: »
    Of course. Just because a lossy file is re-encoded in WAV does not mean it has any more data than it did as an MP3.

    I think he meant - Could you recognize the data was missing?
  • unc2701
    unc2701 Posts: 3,587
    edited August 2009
    Cpyder wrote: »
    I think he meant - Could you recognize the data was missing?

    Exactly- we can make this interesting. Upload 2 wav files, one of which has had data removed due to the mp3 conversion and see how well people can tell.
    Gallo Ref 3.1 : Bryston 4b SST : Musical fidelity CD Pre : VPI HW-19
    Gallo Ref AV, Frankengallo Ref 3, LC60i : Bryston 9b SST : Meridian 565
    Jordan JX92s : MF X-T100 : Xray v8
    Backburner:Krell KAV-300i
  • heiney9
    heiney9 Posts: 25,165
    edited August 2009
    What would that prove? Anyone can use software to compare the WAV files and tell which was derived from an original lossy file. There would be no "control" in the experiment on the listeners end. And frankly no "control" on the uploaders end either.

    I've detected it several times at home. I agree they can be close but the lossy always loses.

    H9
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Pangea AC14SE MKII | Legend L600 | BlueSound Node 3 - Tubes add soul!
  • BlueFox
    BlueFox Posts: 15,251
    edited August 2009
    Cpyder wrote: »
    I think he meant - Could you recognize the data was missing?

    I know what he meant, and that is why I answered. No matter how a file is encoded if the data is missing it will be obvious when compared to a lossless file encoded in the same manner.
    Lumin X1 file player, Westminster Labs interconnect cable
    Sony XA-5400ES SACD; Pass XP-22 pre; X600.5 amps
    Magico S5 MKII Mcast Rose speakers; SPOD spikes

    Shunyata Triton v3/Typhon QR on source, Denali 2000 (2) on amps
    Shunyata Sigma XLR analog ICs, Sigma speaker cables
    Shunyata Sigma HC (2), Sigma Analog, Sigma Digital, Z Anaconda (3) power cables

    Mapleshade Samson V.3 four shelf solid maple rack, Micropoint brass footers
    Three 20 amp circuits.
  • unc2701
    unc2701 Posts: 3,587
    edited August 2009
    Jesus dude, unwad your panties. These things rapidly digress into a pissing contest of who's got the most golden ears and I'm just trying to think of a unbiased means by which we can determine our thresholds. It's up to you to not run software to cheat it out.

    Oh, and I can hear when the guitarist's urine PH is under 5, so I don't know WTF we're even talking about compression bit rates.
    Gallo Ref 3.1 : Bryston 4b SST : Musical fidelity CD Pre : VPI HW-19
    Gallo Ref AV, Frankengallo Ref 3, LC60i : Bryston 9b SST : Meridian 565
    Jordan JX92s : MF X-T100 : Xray v8
    Backburner:Krell KAV-300i
  • heiney9
    heiney9 Posts: 25,165
    edited August 2009
    Sorry if I gave the impression my "panties are in a wad"; they're far from it. I just don't see what it would prove as a whole. Certainly I encourage people to try it at home with their music and if your happy with lossy files.............then "don't worry, be happy".

    But lossy is lossy is lossy so I tend to make my point that 320kbps lossy files are and will never be the same as true WAV files. Much like a digital conversion of an analog signal will never be 100% of the original analog signal.

    Happy listening

    H9
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Pangea AC14SE MKII | Legend L600 | BlueSound Node 3 - Tubes add soul!
  • unc2701
    unc2701 Posts: 3,587
    edited August 2009
    Keiko wrote: »
    You wear panties to H9? I got those ones that have the days of the week embroidered into them. Helps me keep my days straight and I love the way they feel against my sack. :o

    awwwwwwwwwww dammit. didja have to paint that picture? Where's the... shouldn't you be posting asian chicks in the aforementioned panties???

    Anyhow, H9, gotcha. If I listen for it, I can hear it on just about any recording (there's some garbage that I'm pretty certain was _recorded_ lossy), but for a lot of things, I don't care. Out back, grilling. Meh. Stuck at work reading the new SOPs that are just like the old SOPs? Meh.

    'course, I've got the sober turntable and the drunk turntable. I switch over to the technics 1200 when I start thinking I might break something....
    Gallo Ref 3.1 : Bryston 4b SST : Musical fidelity CD Pre : VPI HW-19
    Gallo Ref AV, Frankengallo Ref 3, LC60i : Bryston 9b SST : Meridian 565
    Jordan JX92s : MF X-T100 : Xray v8
    Backburner:Krell KAV-300i
  • mmadden28
    mmadden28 Posts: 4,283
    edited August 2009
    How about some people list some tracks that they use for comparison and what to listen for and where (time) in the track. Not everybody is in tune or knows what to listen for.
    ____________________
    This post is a natural product. The slight variations in spelling and grammar enhance its individual character and beauty and in no way are to be considered flaws or defects.

    HT:Onkyo 805, Emotiva XPA-5, Mitsu 52" 1080p DLP / polkaudio RTi12, CSIa6, FXi3, uPro4K
    2-chnl : Pio DV-46AV (SACD), Dodd ELP, Emotiva XPA-1s, XPA-2, Odyssey Khartago, LSi9, SDA-SRS 2 :cool:, SB Duet, MSB & Monarchy DACs, Yamaha PX3 TT, SAE Tuner...
    Pool: Atrium 60's/45's