Preparing for a TDM Project
While the Libraries actively negotiates for text and data mining permissions, some resources the Libraries subscribes to do not allow users to text and data mine content. For this reason, it is important to always contact your Liaison Librarian or the Digital Scholarship & Data Services department before starting a TDM project on a Libraries' subscribed resource to ensure you are adhering to current licenses and agreements.
Additionally, most publishers/vendors prohibit the use of bots, crawlers, scripts and other automated methods to extract data; doing so can cause the Libraries' access to be terminated.
Some of the issues that need to be addressed before starting a TDM project include:
- Does a specific vendor/publisher allow text and data mining on their platform at all?
- Does the vendor require a detailed project description?
- Are there additional costs and licensing that need to be worked out?
- Does the vendor/publisher allow you to use an AI based TDM tool?
- Can you use a third-party TDM tool on a publisher's platform, or do you have to use their platform specific tool?
- How long can you retain the TDM output?
- Who can you share the TDM output with?
- How can you share the TDM output?
- What is the best way to cite the data in your publications?