Printer Friendly Version
Email this thread to a friend
|
page rank 3 and page rank 5 for sale (In: I Want to Sell My Website)
Redirection of a page (In: Coding & Databases - PHP, ASP, Perl, etc.)
meta nocache tags (In: Google)
Featured Web Site Template |
|
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
paddleasia
Joined: Nov 23, 2004
# Posts: 32
|
Posted: 2005-Mar-15 02:18
I was wondering if there is a way to see all of the pages listed on a website? In other words, can someone see pages that you have applied a 'noindex,nofollow' tag to?
The reason why I ask this is that there are competitors who copy a lot of what I do. I'd like to send hidden pages to clients, but I'm concerned that my comp can find these pages.
Also, which of the following would be best:
<meta name="robots" content="noindex,follow">
<meta name="robots" content="index,nofollow">
<meta name="robots" content="noindex,nofollow">
Thanks
|
 |
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2005-Mar-15 11:08
>> Also, which of the following would be best:
<meta name="robots" content="noindex,follow">
<meta name="robots" content="index,nofollow">
<meta name="robots" content="noindex,nofollow">
Best for what?
This is how it works:
- index means the page will be indexed, noindex means that it will not be.
- follow means the links out from the page will be followed, nofollow means that they will not be.
|
|
paddleasia
Joined: Nov 23, 2004
# Posts: 32
|
Posted: 2005-Mar-15 11:48
Common sense then really. I should have figured that one out.
I now know what to do... thanks for your help.
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2005-Mar-15 19:22
Like most things with computers the answer is often logical, but isn't always obvious especially if it is a topic you haven't looked at before.
I use noindex occasionally, but I have never used nofollow. That one finds its usage in stopping search engines from going into the checkout section of a shopping cart for example.
|
|
paddleasia
Joined: Nov 23, 2004
# Posts: 32
|
Posted: 2005-Mar-16 00:20
Thanks g1smd...
With your helpful advice, I think that <meta name="robots" content="noindex,follow"> is just the ticket.
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2005-Mar-16 11:28
No problem!
Hope it works fine.
|
|
paddleasia
Joined: Nov 23, 2004
# Posts: 32
|
Posted: 2005-Mar-17 00:06
I still need some help with my other question, which is:
I was wondering if there is a way to see all of the pages listed on a website?
I think someone showed me how to do this one time. I think it showed a folder tree or something like that.
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2005-Mar-17 23:53
Google will show you all the pages that it has indexed using the search:
site:domain.com
You can find all the pages on a site, get a report of broken links, and make a sitemap using programs such as Xenu LinkSleuth for example.
|
|
paddleasia
Joined: Nov 23, 2004
# Posts: 32
|
Posted: 2005-Mar-18 00:49
Thanks again... it's so nice to have such quick answers.
|
|
birchj
Joined: Jan 03, 2005
# Posts: 16
|
Posted: 2005-Mar-20 22:19
If there are pages you don't want other people to see. Have them on your site, but don't link to them. If I am a competitor of yours I can follow any link on your site. Instead mail the unlinked URL to your intended recipient.
If you put meta information in your page saying don't follow or you have a robots.txt file saying don't index areas. I can still read it as a browser of your site and see what you don't want me to see.
Non-disclosure is the answer, don't link to, don't allow directory browsing, don't tell search engines what not to do, use file system/web server technology to put a pass word on the files. Use non-predictable path and filenames.
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
