Results 1 to 10 of 10
  1. #1
    Pro
    Points: 57,910, Level: 74
    Level completed: 58%, Points required for next Level: 640
    Overall activity: 8.0%
    Achievements:
    Veteran50000 Experience Points
    intrepid27's Avatar
    Join Date
    Oct 2006
    Location
    Marion, IA
    Posts
    2,545
    Points
    57,910
    Level
    74
    Thumbs Up
    Received: 70
    Given: 60

    Determining age of information on web

    I do a lot of internet research for my job. Is there a way to determine the date a web page was creatated or last updated?

    You used to be able to right click on the page and look at properties and it would give you that info. Now it always says todays date.



  2. #2
    Pro
    Points: 40,441, Level: 62
    Level completed: 7%, Points required for next Level: 1,209
    Overall activity: 1.0%
    Achievements:
    Social25000 Experience PointsVeteran
    CyLoboClone's Avatar
    Join Date
    Oct 2009
    Location
    Albuquerque
    Posts
    2,435
    Points
    40,441
    Level
    62
    Thumbs Up
    Received: 7
    Given: 3

    Re:Determining age of information on web

    Have you guys heard about this Loraina Bobbit thing?



  3. #3
    Pro
    Points: 57,910, Level: 74
    Level completed: 58%, Points required for next Level: 640
    Overall activity: 8.0%
    Achievements:
    Veteran50000 Experience Points
    intrepid27's Avatar
    Join Date
    Oct 2006
    Location
    Marion, IA
    Posts
    2,545
    Points
    57,910
    Level
    74
    Thumbs Up
    Received: 70
    Given: 60

    Re: Determining age of information on web

    bump .



  4. #4
    Rookie
    Points: 17,060, Level: 39
    Level completed: 77%, Points required for next Level: 190
    Overall activity: 10.0%
    Achievements:
    Veteran10000 Experience Points
    dtlantz's Avatar
    Join Date
    Apr 2006
    Location
    Maryland
    Posts
    567
    Points
    17,060
    Level
    39
    Thumbs Up
    Received: 13
    Given: 24

    Re: Determining age of information on web

    Wait. The Loraina Bobbit comment didn't answer your question?



  5. #5
    Addict
    Points: 78,196, Level: 86
    Level completed: 92%, Points required for next Level: 154
    Overall activity: 7.0%
    Achievements:
    Veteran50000 Experience Points

    Join Date
    Jun 2009
    Location
    Chicago, Il
    Posts
    6,280
    Points
    78,196
    Level
    86
    Thumbs Up
    Received: 56
    Given: 15

    Re: Determining age of information on web

    Quote Originally Posted by intrepid27 View Post
    I do a lot of internet research for my job. Is there a way to determine the date a web page was creatated or last updated?

    You used to be able to right click on the page and look at properties and it would give you that info. Now it always says todays date.
    I think it depends on the web page. For example, if the page is generated by a s c r i p t/server side code, then that is why you'll be seeing today's date most likely.

    Not that everyone does it, but an SEO page might have a metadata tag in its HTML. For example <meta name="last-modified" content="....">

    Other than that, it's hit or miss. If these don't exist and there's no date in the actual content of the page, then you might be out of luck.



  6. #6
    Pro
    Points: 57,910, Level: 74
    Level completed: 58%, Points required for next Level: 640
    Overall activity: 8.0%
    Achievements:
    Veteran50000 Experience Points
    intrepid27's Avatar
    Join Date
    Oct 2006
    Location
    Marion, IA
    Posts
    2,545
    Points
    57,910
    Level
    74
    Thumbs Up
    Received: 70
    Given: 60

    Re: Determining age of information on web

    Thanks, how do you find the metadatatag thingamabobber?



  7. #7
    Addict
    Points: 78,196, Level: 86
    Level completed: 92%, Points required for next Level: 154
    Overall activity: 7.0%
    Achievements:
    Veteran50000 Experience Points

    Join Date
    Jun 2009
    Location
    Chicago, Il
    Posts
    6,280
    Points
    78,196
    Level
    86
    Thumbs Up
    Received: 56
    Given: 15

    Re: Determining age of information on web

    Quote Originally Posted by intrepid27 View Post
    Thanks, how do you find the metadatatag thingamabobber?
    Well, caveat is not all pages will have them especially if the website isn't professionally done (most likely, although it doesn't have to be professional done to have this).

    You need to view the HTML "source" of the page (i.e. "View Source"). Then i'd do a search for "<meta"..they're really meant for SEO (search engine optimization). It's really hit or miss if they'll be on a site, but for your sake I hope they are.



  8. #8
    All-Star
    Points: 26,498, Level: 49
    Level completed: 95%, Points required for next Level: 52
    Overall activity: 16.0%
    Achievements:
    Created Album picturesVeteran25000 Experience Points

    Join Date
    Jan 2010
    Location
    Urbandale
    Posts
    1,116
    Points
    26,498
    Level
    49
    Thumbs Up
    Received: 86
    Given: 58

    Re: Determining age of information on web

    Try http://www.archive.org/. It's dark today, though. You can see web sites from when they first were created.



  9. #9
    Starter
    Points: 15,177, Level: 37
    Level completed: 41%, Points required for next Level: 473
    Overall activity: 0%
    Achievements:
    Veteran10000 Experience Points
    ce1's Avatar
    Join Date
    Mar 2006
    Location
    Minnesota
    Posts
    955
    Points
    15,177
    Level
    37
    Thumbs Up
    Received: 0
    Given: 10

    Re: Determining age of information on web

    There is no way to determine the date of publication of a web page, in a reliable manner.

    The best methods are done by the big search engines: Google and Bing. Since they are constantly spidering the web, they keep track of when a page changes by looking at the difference between their previous cache and what is currently there. From that value, you can get an approximate date of publication. There are two caveats: 1) the vast majority of data on the web is very infrequently spidered, with good reason. It never changes - for example, government pages or something with absolutely no traffic. 2)It is easy to game this system, and plenty of low-brow news web sites do this.

    To see this in use, do a google search, then choose the "in last hour" or "in last 24 hours" under the "any time" header on the left side of the results.

    If i remember correctly, the Bing 2.2 Web Service API has a field that tells you when they last detected a change on a web page. This gets returned as part of the search results - you can probably pass the URL of the document you want to date as the search phrase, and get the spidered date.


    Last edited by ce1; 01-18-2012 at 08:02 PM.
    "It's just another gym" -- Jamaal Tinsley, on playing at Phog Allen Fieldhouse

  10. #10
    Addict
    Points: 78,196, Level: 86
    Level completed: 92%, Points required for next Level: 154
    Overall activity: 7.0%
    Achievements:
    Veteran50000 Experience Points

    Join Date
    Jun 2009
    Location
    Chicago, Il
    Posts
    6,280
    Points
    78,196
    Level
    86
    Thumbs Up
    Received: 56
    Given: 15

    Re: Determining age of information on web

    Quote Originally Posted by ce1 View Post
    There is no way to determine the date of publication of a web page, in a reliable manner.

    The best methods are done by the big search engines: Google and Bing. Since they are constantly spidering the web, they keep track of when a page changes by looking at the difference between their previous cache and what is currently there. From that value, you can get an approximate date of publication. There are two caveats: 1) the vast majority of data on the web is very infrequently spidered, with good reason. It never changes - for example, government pages or something with absolutely no traffic. 2)It is easy to game this system, and plenty of low-brow news web sites do this.

    To see this in use, do a google search, then choose the "in last hour" or "in last 24 hours" under the "any time" header on the left side of the results.

    If i remember correctly, the Bing 2.2 Web Service API has a field that tells you when they last detected a change on a web page. This gets returned as part of the search results - you can probably pass the URL of the document you want to date as the search phrase, and get the spidered date.
    Extremely unreliable, and not to mention that a search engine might not hit information brought on with AJAX requests too...

    You can get lucky with the last modified dates in the source, but that doesn't mean all the information on the page is from that date. It could be 1 sentence that got updated, and the rest of the content has been on there for 5 years.

    Very hit and miss



Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
  • Football
  • Iowa State vs. North Dakota State
  • August 30, 2014
  • 11:00 AM