- Joined
- Dec 13, 2006
- Messages
- 11,353
- Reaction score
- 3,179
Hey Everyone...
I don't think we are too far out from a new feature at AGD. This one has been a LONG time in the making, so hopefully will be helpful and appreciated by all. One of the notable functions of the new feature will be the ability to see all of the AGD Scrapes from the spider.
Background and History of AGD:
2006 - AGD Spider was built. This was version 1.0 (ok, maybe 0.6 Beta). It was a php spider that ran on a cron job. It had the unique ability to pick apart terms and conditions and spider only the material of the terms. Worked well, but began to degrade once we had too many terms in the system
2007 - AGD Spider was re-built as a Javascript engine. The spider worked well, but had some issues. The main one was that I don't know Java
I could not re-program without the help of others
2008 - AGD Spider .NET v1.0 was built. It took quite awhile and the end of 2008 was the birth of the new AGD spider. It was a single-tiered application at the time, as I recall.
2010 - AGD Spider .NET V2.0 was completed with a better interface, more features, and the ability to become a multi-tiered application. The application now spanned several servers (The main one being the one AGD members and PAL members helped pay for)
2012 - AGD Spider .NET V3.0 was further integrated with the AGD backend to allow easier terms certifications and alerting. This alerting feature allows other websites to use the RSS Feed (and create a custom version to match their website) to display all AGD Alerts. GPWA, CAP, AGD, and WCD are consumers of this data (although I am unsure if WCD still utilizes their feed).
2013 - AGD Spider .NET v4.0 will begin synchronization of all scrapes and changes to the AGD Forum server. This is in preparation for one of the functions of the new feature....
New Feature Function
Affiliate will now be able to have a look into the AGD spider much like you would look into WebArchive.org. For each affiliate program we have in our system, you will be able to see the terms and conditions SCRAPES (each new scrape of a terms and conditions set) along with all of the CHANGES (the highlighted version of a terms change).
What does this allow you to do? If you know when you signed up for a program, you can grab the terms and conditions at that time and see ALL changes that have occurred since that date.
More to come......... That is just the beginning...
Thank you to our site sponsors (Affiliate Sponsors on homepage) and to our Platinum Sponsors. This is where your money goes.
I don't think we are too far out from a new feature at AGD. This one has been a LONG time in the making, so hopefully will be helpful and appreciated by all. One of the notable functions of the new feature will be the ability to see all of the AGD Scrapes from the spider.
Background and History of AGD:
2006 - AGD Spider was built. This was version 1.0 (ok, maybe 0.6 Beta). It was a php spider that ran on a cron job. It had the unique ability to pick apart terms and conditions and spider only the material of the terms. Worked well, but began to degrade once we had too many terms in the system
2007 - AGD Spider was re-built as a Javascript engine. The spider worked well, but had some issues. The main one was that I don't know Java
I could not re-program without the help of others2008 - AGD Spider .NET v1.0 was built. It took quite awhile and the end of 2008 was the birth of the new AGD spider. It was a single-tiered application at the time, as I recall.
2010 - AGD Spider .NET V2.0 was completed with a better interface, more features, and the ability to become a multi-tiered application. The application now spanned several servers (The main one being the one AGD members and PAL members helped pay for)
2012 - AGD Spider .NET V3.0 was further integrated with the AGD backend to allow easier terms certifications and alerting. This alerting feature allows other websites to use the RSS Feed (and create a custom version to match their website) to display all AGD Alerts. GPWA, CAP, AGD, and WCD are consumers of this data (although I am unsure if WCD still utilizes their feed).
2013 - AGD Spider .NET v4.0 will begin synchronization of all scrapes and changes to the AGD Forum server. This is in preparation for one of the functions of the new feature....
New Feature Function
Affiliate will now be able to have a look into the AGD spider much like you would look into WebArchive.org. For each affiliate program we have in our system, you will be able to see the terms and conditions SCRAPES (each new scrape of a terms and conditions set) along with all of the CHANGES (the highlighted version of a terms change).
What does this allow you to do? If you know when you signed up for a program, you can grab the terms and conditions at that time and see ALL changes that have occurred since that date.
More to come......... That is just the beginning...
Thank you to our site sponsors (Affiliate Sponsors on homepage) and to our Platinum Sponsors. This is where your money goes.
