Candeez's dashboard

paulbakk started following the question "Robots.txt file" in SynthaSite.

Monique replied on September 29, 2008 17:30 to the question "Robots.txt file" in SynthaSite:

I had a colleague take a look at that message. It is a little hard to figure out without being able to see the actual table on your Google dashboard. However, it looks like the message is saying that Google attempted to crawl your preview URL and was blocked by a robots.txt file (as it should have been) and it successfully crawled your adults_jewelry.php and childrens_jewelry.php pages on 23 September. (Indicated by the "Last Crawl Attempt" and "Last Crawled" messages associated with the preview URL and the published URL's respectively.

I checked on this by googling some of the unique text on your page and your site came up first in the search results, which indicates that the page IS being crawled. See:



So basically I have no further instructions for you, other than to confirm that the correct pages on your site are being crawled. I hope this clears things up for you. Once again, I am sorry that it is a bit confusing but from everything that I can see things are functioning exactly as they should.

Candeez replied on September 29, 2008 14:44 to the question "Robots.txt file" in SynthaSite:

Thanks for your response. I will await your further instructions.

Monique replied on September 29, 2008 14:23 to the question "Robots.txt file" in SynthaSite:

That message is telling you what I explained above: That you have robots.txt file on your site and you need to remove it in order for the crawler to access those pages. The first URL - the long one - is your preview URL and it is expected that this one will be blocked. So that is nothing to worry about.

The other two pages, however, should not be blocked. I also could not find a robots.txt file on your site (so I gather you have not tried to upload one yet? correct me if I am wrong). I am not sure why those two pages are being blocked. I will have to get some advice on this.

In the meantime please do not try to upload a robots.txt file as that is the exact opposite of what you want to be doing! I am sorry that the message is ambiguous. However, for the sake of anyone with the same question the message from Google is saying:
"That page on your site is blocked because you have a robots.txt file instructing the search engines not to crawl it - remove this file in order to allow access to this page."
NOT
"that page is blocked and you need to upload a robots.txt file in order to allow access."

Candeez replied on September 29, 2008 13:19 to the question "Robots.txt file" in SynthaSite:

This is what I have got

Blocked URL Reason Blocked [?] Last Crawl Attempt
http:/ / ide. synthasite. com/ sites/ De77/ D73b/ D197/ D524/ U402881b21909fb5f0119425791b3777e/ 402881b21909fb5f011946fbcbf01a96/ Reason Robots.txt File Last crawled 23 Sep 2008
Adults_jewellery. php Robots.txt File 23 Sep 2008
Childrens_jewellery. php Robots.txt File 23 Sep 2008

A comment on the question "Robots.txt file" in SynthaSite:

Thanks for the suggestions Ed - definitely a good place to start. I have pursued another line of questioning below, because we are seeing a lot of cases where Google Webmaster tries to crawl our preview URL's (which are blocked by SynthaSite's robots.txt file in order to prevent Google from indexing unpublished sites). We usually find that the person has either submitted their preview URL to Google by mistake, or they have a link to their preview URL somewhere on their site. However, in Candeez's situation I don't know for sure if any of this is the case, so I need to get more information. I am very interested to find out the answer both to help in this instance, and in other similar cases! – Monique, on September 24, 2008 12:50

Monique replied on September 24, 2008 12:45 to the question "Robots.txt file" in SynthaSite:

Hi Candeez

Does the error message from Google say: "Reason blocked: robots.txt file"? If so, Google is telling you to remove the robots.txt file, not asking you to add one.

What is the URL of the blocked pages? Please check that it is not your preview URL (the long URL you see when you preview your page from the site builder). Make sure it is your published URL - the URL you see in your browser window when you navigate to those pages on your published site.

If it is your preview URL that would explain why the pages are blocked, but I would like to know why Google Webmaster has attempted to crawl those pages.

If it is your published URL then I need to find out why Google is referencing a robots.txt file (unless you have uploaded one, of course)

I would really appreciate it if you could get back to me with the answer to these questions. Either post the exact error message from Google or email it to us. I would like to get to the bottom of exactly which URL's Google is referencing and why you are getting a message about a robots.txt file.

ed replied on September 24, 2008 11:10 to the question "Robots.txt file" in SynthaSite:

Hi there Candeez

Sorry you are having problems

Have you gone to the Google webmaster tools site and clicked on the (Tools) button on the middle left and then clicked the (Analyze robot.txt) button and then in the very bottom box copy each of your URLs from every one of your pages and paste them one per line in the text box. Leave the drop down box alone for now then press (Check)

If all your URLs are green (Allowed) then you are fine. If the two that you had mentioned are not (Allowed) then you should check that you don't have a robot.txt file in your file manager that may be affecting those two pages. If it is there and you wish you could try removing it from your file manager then update your site and try the robot test once more.

As to the drop down box I said not to touch earlier. You can select from the list and test each one individually if you like.

I hope that offered some help but I am off to sleep now and real tired...

Good luck.

Ed

Candeez asked a question in SynthaSite on September 24, 2008 10:27:

Robots.txt file

Google diagnostics have reported that 2 pages are blocked on my site. It states I should add a robots. txt.file to those pages. I have read your earlier answer to a smilar problem where you state do not add a robot txt file you you want the crawlers to crawl the site. This is only happening to childrens jewellery and adults jewllery pages. What can be done to fix the problem?

max started following the question "Website doesn't work" in SynthaSite.

max started following the question "Website doesn't work" in SynthaSite.

Sean Nieuwoudt replied on August 13, 2008 01:25 to the problem "Help with html shopping cart" in SynthaSite:

Hi Candeez,

I replied to your support email.

Regards,
Sean

A comment on the problem "Help with html shopping cart" in SynthaSite:

Hi Candeez. I am following up with Sean about this. Our apologies for the long delay! – Monique, on August 12, 2008 13:29

Candeez replied on August 12, 2008 13:16 to the problem "Help with html shopping cart" in SynthaSite:

Hi Sean or the tech team. Can you please have a look at this problem, as it still isn't working. Thanks

Candeez replied on July 25, 2008 12:16 to the problem "Help with html shopping cart" in SynthaSite:

Hi Sean

I have sent you a couple of emails at the above for the screenshot but have not received an answer. Please help as the problem still exists.

sarah101 started following the question "Website doesn't work" in SynthaSite.

Sean Nieuwoudt replied on July 03, 2008 14:36 to the problem "Help with html shopping cart" in SynthaSite:

Hi Candeez,

I found the problem, I would have to email you a screenshot to explain why its not working as it should. Could you please contact support@synthasite.com with "Att: Sean" and your query and I will reply with the screenshot and solution.

Regards,
Sean

Candeez replied on July 03, 2008 14:16 to the problem "Help with html shopping cart" in SynthaSite:

If you mean the shopping cart code, I got it direct from the paypal website and cut and pasted into the html.
When I've taken it out and started afresh with the paypal site the same thing happens.
Does this mean that I will have to do the whole page again?

Sean Nieuwoudt replied on July 02, 2008 14:44 to the problem "Help with html shopping cart" in SynthaSite:

Hi Candeez,

The code you used to layout your page, did you get it from a program or copy and paste it from somewhere other than PayPal? it seems most of it does'nt have the tag attribute values quoted as should be.

Regards,
Sean

Adrienne replied on July 01, 2008 20:31 to the problem "Help with html shopping cart" in SynthaSite:

Hi Candeez,

Normally, this is how PayPal shopping carts are added:

If you already have a PayPal account, you need to copy their HTML embed code to add a button.

Then do the following:
1) Drag and drop an HTML widget from the sidebar on the right onto your page
2) Paste the code over the default tags in the HTML editor
3) Click "ok" and your paypal button should then be embedded in your page.

I'm mentioning this mainly for our SynthaSite community. However, when I went to your site I indeed noticed the problem you described on your new plaques page.

I'm going to get together with our developers, and ask if they can bug test for this for us, and I should have the answer for you tomorrow.

Thanks very much for pointing this out to us,

~ Adrienne