I’m indifferent

Duplicate Domains

Some domains have duplicate sub-domains in the top score, For example our site (#13 www.rikoshay.nl) and its subdomain (#14 rikoshay.nl) and some others,
#4 www.Capica.nl & #6 capica.nl

Is it possible to do a similarity test on domains? meaning if a www subdomain is rated and it checks the subdomain without the www and the content is exaclty the same then it simply redirects to the www subdomains scorecard.

Shouldnt be too hard i suppose?
8 people like
this idea
+1
Reply
  • EMPLOYEE
    I’m happy
    1
    Andy (PHP Developer) May 05, 2010 13:57
    Hi,

    Technically Nibbler is correct - the two sites have separate addresses and as so are separate websites with separate scores.

    I agree that Nibbler should detect for this, but it should probably penalise or at least warn sites which do this as it isn't best practice.

    If you want to use both the TLD (e.g. rikoshay.nl) and the www. sub domain, you should have one redirecting to the other (whichever you prefer) and have just one version of the site.

    e.g. try visiting http://silktidestudios.com

    Thanks,
    Andrew
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • EMPLOYEE
    I’m an oracle, apparently
    1
    Oliver Emberton (Managing Director) May 10, 2010 22:35
    Andy - before you time at Silktide I know, but to quote from my Nibbler/Sitescore spec (2008):

    These URLs will appear differently to Sitescore, but identical to most people:

    * www.example.com
    * example.com/
    * www.example.com/index.html
    * example.com/home.asp

    For Free Sitescore this can become a major problem with league tables, as people often see say the top rated 3 sites like so:

    * www.w3.org
    * w3.org
    * w3.org/index.html

    For Sitescore 3 the same problem exists but is noticed less often. The spider is effected by this however (see Sitescore Spider).

    The best identified solution so far is to automatically test whether sites prefixed by www. also have an equivalent that doesn't have www.. If an equivalent is found, always use the version without the prefix. Determining 'equivalent' was originally testing whether the content for each URL matches. URLs with no content (e.g. HTTP redirections) are problematic and were ultimately considered as a match only if they pointed to the same URL (not always accurate).

    In addition, supporting anything but top-level domain names has always proven problematic. Consider:

    * www.hsbc.com
    * www.hsbc.com/1/2
    * www.hsbc.com/1/2/

    Again identical but prone to different results in Sitescore - the different homepage for instance would score different SEO scores (e.g. if "www.hsbc.com/1/2" was #1 in Google but "www.hsbc.com" was not, or vice versa).

    The result is users complain because they get different scores for what they consider to be the same site, and the similarly scoring sites appear in the league tables as separate entries.

    Previously the only workable solution found was to block all URLs except plain domain names, which was unpopular with some but effective.

    http://wiki.silktide.com/Sitescore_UR...
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m confused
    I just noticed this and it confused me. They need to be de-duped in Nibbler, or something, it just doesn't make sense.

    If they are the same, they should redirect to one or the other, if they don't, then mark the score down.

    If they do redirect to one then all is well.

    If one does not work e.g. (I still can't believe this happens) with http://derby.ac.uk and http://www.derby.ac.uk then penalise as well.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m confident
    Hi again,

    Could you possible remove
    rikoshay.nl
    schuitstukadoorsbedrijf.nl
    vriendschapsbureau.nl
    keijzer-schilders.nl

    from the List?
    (I own all these domains, please see )
    http://www.rikoshay.nl/onze-projecten/1/

    I have placed 301's with all these domains and all other domains we currently own. so this should not become a problem from us again

    Thank you in advance
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m sad
    1
    Nibbler still doesn't penalize this? Way to many website are abusing this and monopolizing top website list.

    1. www.rikoshay.nl
    2. www.hotelslanic.ro
    3. hotelslanic.ro
    5. stastka.ch
    etc...
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m confident
    True, but i asked if they could give us a way to restrict this behaviour, i'm waiting to see what happens with the new release of nibbler, i'd say let it be for now (untill new version)
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • Well, webmasters should put redirects or at least canonical tag, if there isn't one Nibbler should penalize their website.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m indifferent
    1
    Well, if you think about it in a technical maner,
    Lets use my domain,
    1. rikoshay.nl
    2. www.rikoshay.nl

    #1 and #2 could contain completely different content, and thus is considered as different subdomains by nibbler (so does google, yahoo ect)
    Therefore it is rated as different websites in itself, I mean, if you look at it out of a SEO point of view using #1 as your main domain is better as its a cleaner link.

    And i highly doubt nibbler is the Judge of websites you make it out to be, it simply shows scores, but i do think they should give the webmaster a choice to which one they want to display, and once there's a choice, then you can introduce penatlies

    (Just my point of view)
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m confused
    I have several domains.
    All my domains are routed to the www. addresses.
    I think this can be done by DNS setting.

    So if you go to safeunderdark.com, you'll end up on www.safeunderdark.com.

    Why is this not always the case, or is this also a choice you can do ?

    I see many www.domain.com addresses that are unreachable on the domain.com URLs.

    But it would be nice to have a choice, to -opt-out so to speak.

    or have you score calculated but not listed, or added to it's top domain.

    just my 2 cents
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • 1
    Well the www infront of a domain is not different from any other subdomain, for example

    http://admin.rikoshay.nl
    http://howto.rikoshay.nl
    http://www.rikoshay.nl
    http://rikoshay.nl

    Even though the last 2 show the same content, it isnt the same thing. Having this rerouted / redirected is kind of something i see as a webstandard, but it's not a strict rule. to answer your question, yes this is a choice you have, so many lazy webdevelopers just never do it.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m thankful
    Thank you, that does make sense (lazy web-developers -lol-)
    Just one question, is this the same as it goes for page URLs ?

    I have the root of my site /
    it shows the same page as /EN-Home
    (has something to do with re-write rules as I'm told)

    So it would be best to link to /EN-Home at the start and not to /
    right ?
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • Well, thats mostly got to do with personal prefference, aslong as you keep it consistant, and not sometimes link to ~/ and other times link to ~/EN-Home

    But i see you have 2 languages, So why not make the Home page of the english ~/ and the home page of the dutch ~/NL-Home?

    http://www.safeunderdark.com/ and http://www.safeunderdark.com/EN-Home
    is the same page, so it'd be wise to redirect one of the 2 to the other one, if your not sure what i mean, feel free to ask

    (As i said, this is personal prefferance)
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly

  • I’m happy
    It has to do with the language Module.

    Pages start with EN- NL- DU- etc.
    So if you are on EN-About, and change language it will show - About.
    So that has to be consistent, English is the default language,
    so EN-Home is the startpage of the site.
    Hence it is also shown as root, but insite the site it is always referred to as EN-Home.

    So I can't just link EN-Home to root. because it already is ;)

    I might just change the mod-rewrite to show the EN-Home if the root is accessed ;)

    Thank you
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited sad, anxious, confused, frustrated indifferent, undecided, unconcerned kidding, amused, unsure, silly