Consumer Ratings of Electronics

NeilGabriel
NeilGabriel Posts: 1,487
edited October 2010 in Electronics
I have been trying to compare reviews on various pre/pros. Most magazines always come down on the plus side...otherwise, there goes the free equipment and ads, huh?

So, I go to a site like audioreview.com and see what mostly real people say.
No matter the product, there are always some honest sounding low raters on otherwise highly rated products. Is this just a function of quality control...so many bad apples do leave the factory? Sometimes, I am sure it is a user issue.

Is there any place that shows reliability/frequency of repair stats for audio equip the way that consumer reports does for various goods?

Thanks....
Post edited by NeilGabriel on

Comments

  • heiney9
    heiney9 Posts: 25,398
    edited September 2010
    audioreview is a crap shoot website because you have no idea of the experience of the reviewer or the fact that they are severly biased or can even use the gear properly. Also set-ups as far as room and associated equipment can have a HUGE impact on subjective listening. Most people only take time to review something if they have negative things to say.

    Use it as a very, very loose guide. I've found over the years some absolutely awful and downright idiotic reviews at audioreview.com. Then I've also found a few gems in there. I always try to look at the associated gear or gear used section. You can sometimes tell a lot about the reviewer with the gear they have used and/or owned.

    If I see a review for SDA's and it's basically negative and the reviewer has only owned Cerwin Vega's and Bose...............the review has no merit to me. Or if they review some other nice upper brand of speaker, etc.

    H9
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Puritan Audio PSM136 Pwr Condtioner & Classic PC's | Legend L600 | Roon Nucleus 1 w/LPS - Tubes add soul!
  • tonyb
    tonyb Posts: 33,065
    edited September 2010
    I always find that when reading any reviews to take them with a grain of salt. Too many variables, associated gear, reviewers that are clueless, room used to review, and so on. You can drive yourself crazy trying to make sense of it all. As far as reliability issues go, every product pushes out a lemon here and there, just the nature of mass production. I go to places like HT mag for tech reviews only because they list associated gear and fill you in on some pitfalls. Audio review is good too for user reviews but everyones opinion is just that...an opinion.
    HT SYSTEM-
    Sony 850c 4k
    Pioneer elite vhx 21
    Sony 4k BRP
    SVS SB-2000
    Polk Sig. 20's
    Polk FX500 surrounds

    Cables-
    Acoustic zen Satori speaker cables
    Acoustic zen Matrix 2 IC's
    Wireworld eclipse 7 ic's
    Audio metallurgy ga-o digital cable

    Kitchen

    Sonos zp90
    Grant Fidelity tube dac
    B&k 1420
    lsi 9's
  • shack
    shack Posts: 11,154
    edited September 2010
    Audioreview is not worth the time it takes to type in the URL...IMO.
    "Just because you’re offended doesn’t mean you’re right." - Ricky Gervais

    "For those who believe, no proof is necessary. For those who don't believe, no proof is possible." - Stuart Chase

    "Consistency requires you to be as ignorant today as you were a year ago." - Bernard Berenson
  • heiney9
    heiney9 Posts: 25,398
    edited September 2010
    I've had some gear that got stellar reviews and 1000% lived up to those reviews like my Pass Labs Aleph 30.

    I've had some gear get great reviews and I didn't care for it like certain Cambridge cdp's.

    I've had some gear get luke warm reviews and to me I thought it sounded great, IMO.

    So use amatuer reviews with a few grains of salt and professional reviews with lesser grains of salt, but still be leary of biases, likes, dislikes, associated equipment, etc, etc.

    H9

    P.s. The above reviews in question were all from leading professional reviewers from national magazines or heavy hitters in the audio industry.
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Puritan Audio PSM136 Pwr Condtioner & Classic PC's | Legend L600 | Roon Nucleus 1 w/LPS - Tubes add soul!
  • CTTE
    CTTE Posts: 183
    edited September 2010
    Check out this site for reviews:

    http://www.testfreaks.com
  • TORI3
    TORI3 Posts: 234
    edited September 2010
    CTTE wrote: »
    Check out this site for reviews:

    http://www.testfreaks.com

    Ditto on Test Freaks.

    It sure would be nice if Consumer Reports dedicated a month to new and used Hi-Fi equipment -- Much like the issue on new and used cars. It might establish some sort of baseline that we could all go on for future purchases.
    HT: RTi8s, CSi3, RTi4s, HSU ULS-15, Pioneer Elite VSX-23TXH, Sunfire Cinema Seven.
    2CH: CJ MF2300, Parasound P3, PS Audio DLIII, Wadia 170i, Music Hall Maverick, Sierra-1s, Sunfire HRS8
  • heiney9
    heiney9 Posts: 25,398
    edited September 2010
    TORI3 wrote: »
    Ditto on Test Freaks.

    It sure would be nice if Consumer Reports dedicated a month to new and used Hi-Fi equipment -- Much like the issue on new and used cars. It might establish some sort of baseline that we could all go on for future purchases.

    Consumer Reports is simply awful for that kind of stuff. For a washer or coffee pot sure they do a decent review job. But to review audio equipment, NO WAY. This hobby is way too subjective and there are far too many variables for someone who is not a hobbiest (like the people who review stuff at CR) to be valid in any way shape or form.

    H9
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Puritan Audio PSM136 Pwr Condtioner & Classic PC's | Legend L600 | Roon Nucleus 1 w/LPS - Tubes add soul!
  • Knucklehead
    Knucklehead Posts: 3,602
    edited September 2010
    heiney9 wrote: »
    Consumer Reports is simply awful for that kind of stuff. For a washer or coffee pot sure they do a decent review job. But to review audio equipment, NO WAY. This hobby is way too subjective and there are far too many variables for someone who is not a hobbiest (like the people who review stuff at CR) to be valid in any way shape or form.

    H9

    +1......CNET has always been pretty helpful on certain low cost items.
    Polk Audio Surround Bar 360
    Mirage PS-12
    LG BDP-550
    Motorola HD FIOS DVR
    Panasonic 42" Plasma
    XBOX 360[/SIZE]

    Office stuff

    Allied 395 receiver
    Pioneer CDP PD-M430
    RT8t's & Wharfedale Diamond II's[/SIZE]

    Life is one grand, sweet song, so start the music. ~Ronald Reagan
  • TORI3
    TORI3 Posts: 234
    edited September 2010
    heiney9 wrote: »
    Consumer Reports is simply awful for that kind of stuff. For a washer or coffee pot sure they do a decent review job. But to review audio equipment, NO WAY. This hobby is way too subjective and there are far too many variables for someone who is not a hobbiest (like the people who review stuff at CR) to be valid in any way shape or form.

    H9

    Totally get where you're coming from, but here's a friendly response: Aren't cars just as subjective as audio equipment? Ex: preferences in steering, suspension, "ride," and interior layout of a car....Chevy vs Ford (trucks especially).

    You're right, I don't know too many hobbiest that review cars for a living, but there sure are a lot of experts from their respected fields that conduct these tests. Maybe I'm completely wrong on this next statement, but I highly doubt the group of guys reviewing a coffee pot, are also the same group of guys reviewing the new Challenger. I'm sure CR is competent enough to implement some sort of compartmentalization in respect to their standards of testing.

    I understand that audio/video has way too many variables (types of components, speaker cable, interconnects, power conditioners, sound treatments, room dimensions, furnishing, etc...) that negatively of positively effect synergy.

    I'd go on, but this is way too long, and probably way off topic.

    Food for thought (at least).
    HT: RTi8s, CSi3, RTi4s, HSU ULS-15, Pioneer Elite VSX-23TXH, Sunfire Cinema Seven.
    2CH: CJ MF2300, Parasound P3, PS Audio DLIII, Wadia 170i, Music Hall Maverick, Sierra-1s, Sunfire HRS8
  • billbillw
    billbillw Posts: 7,457
    edited September 2010
    Believe about 1/3 of what you read. The pro magazine reviews are unobjective sellouts for the most part (except for JGH, rest his sole). For some reason, I've come to trust about 1/2 of what Arthur Salvatore has to say, but even he tends to be close minded at times. Sometimes you can find some really useful discussion in the forums of all places ;)
    Here, Audiokarma, Audiogon, AudioCircle. AudioAsylum seems to be less useful.
  • TORI3
    TORI3 Posts: 234
    edited September 2010
    Yea, you unfortunately make a great point, Bill.

    +1 on finding useful information in forums like Polk.
    HT: RTi8s, CSi3, RTi4s, HSU ULS-15, Pioneer Elite VSX-23TXH, Sunfire Cinema Seven.
    2CH: CJ MF2300, Parasound P3, PS Audio DLIII, Wadia 170i, Music Hall Maverick, Sierra-1s, Sunfire HRS8
  • Polkie2009
    Polkie2009 Posts: 3,834
    edited October 2010
    +1 also on helpful information from the very knowledgeable audiophiles here at CP. Bill,you are talking about Julian right? If so, I always enjoyed his reviews over the years.
  • Fongolio
    Fongolio Posts: 3,516
    edited October 2010
    It appears to me that consumers leave reviews if they are really happy with a product or really unhapppy. Very few in between reviews. I use audioreview.com as a very general guide. If the product I'm researching has all five star reviews than it's a good bet that product is pretty good. However, many times there will be a few very low ratings in with the five stars. These may be a setup issue, a singularity, a jaded consumer. A perfect example in our little world is SDA's; not everyone likes the dimensional array sound. Most love it and would likely give almost any SDA a five star rating, but a few may give them very low ratings because they don't like the sound or they have a blown driver and don't know it etc.

    Long story short, use "consumer" ratings only as a very general guide. Most professional ratings are tainted because of advertising, gifts, etc, however they are usually a great way to get technical details on a piece of equipment. In the end it's your ears on your setup that will be the best review. Enjoy.

    Kelvin
    SDA-1C (full mods)
    Carver TFM-55
    NAD 1130 Pre-amp
    Rega Planar 3 TT/Shelter 501 MkII
    The Clamp
    Revox A77 Mk IV Dolby reel to reel
    Thorens TD160/Mission 774 arm/Stanton 881S Shibata
    Nakamichi CR7 Cassette Deck
    Rotel RCD-855 with modified tube output stage
    Cambridge Audio DACmagic Plus
    ADC Soundshaper 3 EQ
    Ben's IC's
    Nitty Gritty 1.5FI RCM
  • NeilGabriel
    NeilGabriel Posts: 1,487
    edited October 2010
    heiney9 wrote: »
    Consumer Reports is simply awful for that kind of stuff. For a washer or coffee pot sure they do a decent review job. But to review audio equipment, NO WAY. This hobby is way too subjective and there are far too many variables for someone who is not a hobbiest (like the people who review stuff at CR) to be valid in any way shape or form.

    H9



    I think frequency with which products have to be returned or taken somewhere for repairs would be a good measure. Even assuming a number of "Problem" products are operator error or some other non-product issue that should equalize out across product lines...just as it might for cameras or computers....but then you could see the percentage of a given line of products that has to be returned...hell, we could do our own poll by brand....

    for quite awhile, I stayed away from NAD because places like Spearit Sound had so many refurbished units....maybe the number just seemed high because they dealt in them...

    I've also been curious about products for which there seems to be a high volume of turnover as seen on a site like Audiogon (like the Rotel RMB-1075), but that could also just indicate how many were sold.

    Occasionally, I also have seen a pattern in consumer complaints about audio products across a variety of sites....various buyers all dealing with the same issue....this has led me to stay away from some products...
  • acmf74
    acmf74 Posts: 937
    edited October 2010
    I ask Club Polk....
  • heiney9
    heiney9 Posts: 25,398
    edited October 2010
    I think frequency with which products have to be returned or taken somewhere for repairs would be a good measure. Even assuming a number of "Problem" products are operator error or some other non-product issue that should equalize out across product lines...just as it might for cameras or computers....but then you could see the percentage of a given line of products that has to be returned...hell, we could do our own poll by brand....

    Well, talking with Al Ballard at Polkfest he says Polk has 30% return rate at on-line retailers, so if we go by that according to your feelings no one here should buy Polk. :)
    I've also been curious about products for which there seems to be a high volume of turnover as seen on a site like Audiogon (like the Rotel RMB-1075), but that could also just indicate how many were sold.

    IMO, not really a great indicator because great pieces like Pass, Belles, NAD, BAT, Parasound, Cambridge, etc are FS all the time. There are many audiophiles here on CP who simply like to own as many pieces as possible and flip stuff on a regular basis. Especially on Audiogon, there are people like that. Also keep in mind beyond Ebay, Audiogon is the ONLY place to sell higher end gear on-line, so you get a lot of gear FS in one place...........that skews the stats heavily.
    Occasionally, I also have seen a pattern in consumer complaints about audio products across a variety of sites....various buyers all dealing with the same issue....this has led me to stay away from some products...

    This is true, but not a deal breaker for me. If it's an established, reputable manufacturer, they can have bad days too.

    H9
    "Appreciation of audio is a completely subjective human experience. Measurements can provide a measure of insight, but are no substitute for human judgment. Why are we looking to reduce a subjective experience to objective criteria anyway? The subtleties of music and audio reproduction are for those who appreciate it. Differentiation by numbers is for those who do not".--Nelson Pass Pass Labs XA25 | EE Avant Pre | EE Mini Max Supreme DAC | MIT Shotgun S1 | Puritan Audio PSM136 Pwr Condtioner & Classic PC's | Legend L600 | Roon Nucleus 1 w/LPS - Tubes add soul!