0.0
No release in over a year
Metadata harvester that follows the FAIR Signposting specification.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Runtime

~> 2.0
~> 5.11.2
~> 13.0
~> 3.11
~> 1.7
~> 3.2.0
~> 3.0.0
 Project Readme

FspHarvester

EXPERIMENTAL: DO NOT USE

Installation

Add this line to your application's Gemfile:

gem 'fsp_harvester'

And then execute:

$ bundle install

Or install it yourself as:

$ gem install fsp_harvester

Usage

require 'fsp_harvester'

ENV['EXTRUCT_COMMAND'] = "extruct"
ENV['RDF_COMMAND'] = "/home/user/.rvm/gems/ruby-3.0.0/bin/rdf" # kelloggs distiller
ENV['TIKA_COMMAND'] = "http://localhost:9998/meta" # assumes using the docker version of tika

# to only follow the FAIR signposting specification:
links, metadata = HarvesterTools::Utils.resolve_guid(guid: guid)

links.each do |link|
    puts link.href
    puts link.relation
end

# note, you don't need to catch the return value here.  The metadata object that is passed in will be modified
metadata = FspHarvester::Utils.gather_metadata_from_describedby_links(links: links, metadata: metadata)

linkeddata = metadata.graph
hashdata = metadata.hash
comments = metadata.comments
warnings = metadata.warnings

# if you want to try other things like content negotiation and "scraping" from HTML, do this:
# note, you don't need to catch the return value here.  The metadata object that is passed in will be modified
metadata = HarvesterTools::BruteForce.begin_brute_force(guid: guid, metadata: metadata)

linkeddata = metadata.graph
hashdata = metadata.hash
comments = metadata.comments
warnings = metadata.warnings

Development

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/markwilkinson/fsp_harvester.

License

The gem is available as open source under the terms of the MIT License.