Greenstone Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
<TABAREA tabs="Greenstone3,Greenstone2">
<TAB>======Greenstone 3.08 tutorial exercises (26 Aug 2016)======

  * These work with Greenstone 3.08. [[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/all_tutorials.html|Print version]]
  * Each tutorial that requires sample files has a link to a zip download of the files. Alternatively, you can download all of the sample files for all of the tutorials in a single [[http://wiki.greenstone.org/gsdoc/tutorial/3.08/sample_files/sample_files.zip|sample_files.zip]]. 

  * Tutorials for older versions of Greenstone can be found at the [[legacy:tutorials | Old Tutorials ]] page.

**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/small_html_collection.htm|Building a small collection of HTML files]]**

  * Running the Greenstone Librarian Interface
  * Starting a new collection
  * Adding documents to the collection
  * Building the collection
  * Viewing the extracted metadata
  * Viewing the internal links and external links
  * Setting up a shortcut in the Librarian interface


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/simple_image_collection.htm|A simple image collection]]**

  * Adding Title and Description metadata
  * Change Format Features to display new metadata
  * Changing the size of image thumbnails
  * Adding a browsing classifier based on Description metadata
  * Creating a searchable index based on Description metadata


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/images_gps.htm|An image collection with GPS metadata]]**
  * Extracting embedded metadata
  * Adding in a map view to browsing
  * Adding in a map view to a document


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/word_pdf_collection.htm|A collection of Word and PDF files]]**

  * Viewing the extracted metadata
  * Manually adding metadata to documents in a collection
  * Document Plugins
  * Search indexes
  * Browsing classifiers


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/formatting_word_pdf.htm|Formatting the Word and PDF collection]]**

  * Tidying up the default format statement
  * Linking to Greenstone version or original version of documents
  * Making bookshelves show how many items they contain
  * Displaying multi-valued metadata
  * Advanced multi-valued metadata


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/pdfbox-extension.htm|Processing newer versions of PDF with PDFBox]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/enhanced_pdf.htm|Enhanced PDF handling]]**

  * Modes in the Librarian Interface
  * Splitting PDFs into sections
  * Using image format
  * Using process_exp to control document processing (advanced)
  * Opening PDF files with query terms highlighted


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/enhanced_word.htm|Enhanced Word document handling]]**

  * Using Windows native scripting
  * Modes in the Librarian Interface
  * Defining styles
  * Removing pre-defined table of contents
  * Extracting document properties as metadata


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/associated_files.htm|Associated files: combining different versions of the same document together]]**

//This tutorial demonstrates how to link different versions of the same document together in Greenstone.//
  * Associating one document with another
  * Linking to associated documents


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/large_html_collection.htm|A large collection of HTML files—Tudor]]**

  * Extracting more metadata from the HTML
  * Looking at different views of the files in the Gather and Enrich panels


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/enhanced_html_collection.htm|Enhanced collection of HTML files—Tudor]]**

  * Adding hierarchically-structured metadata and a Hierarchy classifier
  * Adding a hierarchical phrase browser (PHIND)
  * Partitioning the full-text index based on metadata values
  * Controlling the building process


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/formatting_tudor.htm|Formatting the HTML collection—Tudor]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/section_tagging.htm|Section tagging for HTML documents]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/downloading_from_internet.htm|Downloading files from the web]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/web_linking.htm|Pointing to documents on the web]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/bibliography_collection.htm|Bibliographic collection]]**

  * Using fielded searching
  * Exploding the database
  * Reformatting the collection to use the exploded metadata


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/cds_isis.htm|CDS/ISIS collection]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/multimedia_collection_explore.htm|Looking at a multimedia collection]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/multimedia_collection_build.htm|Building a multimedia collection]]**

  * Manually correcting metadata
  * Browsing by media type
  * Using switch statements
  * Using AZCompactList rather than List
  * Making bookshelves show how many items they contain
  * Adding a Phind phrase browser
  * Branding the collection with an image
  * Using UnknownPlugin
  * Cleaning up a title browser using regular expressions
  * Using different icons for different media types
  * Building a full-size version of the collection


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/scanned_image_collection.htm|Scanned image collection]]**

  * Grouping documents by series title and displaying dates within each group
  * Browsing documents by Date.
  * Searching at page level


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/advanced_scanned_image_collection.htm|Advanced scanned image collection]]**

  * Adding another newspaper to the collection
  * XML based item file


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/OAI_collection.htm|Open Archives Initiative (OAI) collection]]**

  * Tweaking the presentation with format statements


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/GS_OAI_server.htm|Setting up your Greenstone OAI Server]]**

  * Validating the Greenstone OAI server


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/OAI_downloading.htm|Downloading over OAI]]**

  * Downloading using the Librarian Interface
  * Downloading using the command line
  * Building the downloaded documents in GLI


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/METS_export.htm|Use METS as Greenstone's Internal Representation]]**



**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/dspace_to_greenstone.htm|Moving a collection from DSpace to Greenstone]]**

  * Adding indexing and browsing capabilities to match DSpace's


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/greenstone_to_dspace.htm|Moving a collection from Greenstone to DSpace]]**

  * Using Greenstone from the command line


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/gems.htm|Editing metadata sets]]**

  * Running GEMS
  * Creating a new metadata set
  * Adding a new element to a metadata set


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/indexers.htm|Building and searching with different indexers]]**

  * Build with Lucene
  * Search with Lucene
  * Build with MGPP
  * Search with MGPP
  * Use search mode hotkeys with query term
  * A quick reference of the search mode hotkeys in MGPP

**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/incremental_cmdline.htm|Incrementally building a collection using the command line]]**

  * Incrementally adding some additional new documents to a collection
  * Incrementally deleting some documents from a collection
  * Editing a document's text and metadata, and then incrementally rebuilding the collection
  * Incrementally indexing automatically

===== Customization =====

**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/using_themes.htm|Customization: Themes]]**

  * Using Greenstone Visual Themes
  * Creating a custom theme using ThemeRoller (advanced)


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/collection_themes.htm|Collection-Specific Themes]]**

  * Creating a custom theme
  * Setting a collection's theme


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/home_page.htm|Customizing your home page]]**

  * Changing the library's home page
  * Adding the list of collections
  * Adding a cross-collection search box
  * Login Links
  * Adding your library's site name
  * Changing your library's site name


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/defining_libraries.htm|Defining Libraries]]**

  * Exploring libraries
  * Creating a new site
  * Defining a new library
  * Adding and using a new interface
  * Changing default settings for the Greenstone server and GLI


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/new_interface1.htm|Designing a new interface: Part 1]]**

  * Creating a new interface
  * Defining a new library
  * Gathering files


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/new_interface2.htm|Designing a new interface: Part 2]]**

  * Changing the home page content
  * Changing the HTML header content


**[[http://wiki.greenstone.org/gsdoc/tutorial/3.08/en/new_interface3.htm|Designing a new interface: Part 3]]**

  * Examining main.xsl
  * Adding a navigation bar
  * Adding functionality to the quick search box
  * Adding the library name and login links
  * Interface language files


</TAB>
<!-- ##############################################################################################
#################################################################################################
##################################################-->
<TAB>
====== Greenstone 2.87 tutorial exercises (September 2017) ======

  * These work with Greenstone 2.87. [[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/all_tutorials.html|Print version]] 
  * For installation and setup instructions, and for patches, refer to the [[en:release:2.87_release_notes | 2.87 Release Notes]].
  * Each tutorial that requires sample files has a link to a zip download of the files. Alternatively, you can download all of the sample files for all of the tutorials in a single [[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/sample_files/sample_files_all.zip|sample_files_all.zip]]. 

  * Tutorials for older versions of Greenstone can be found at the [[legacy:tutorials | Old Tutorials ]] page, including Spanish, French and Russian translations of the 2.70 (March 2006) version.


<!--**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/unaids_cdrom.htm|Working with a pre-packaged collection (UNAIDS)]]**
  * Installing a pre-packaged Greenstone collection
  * Browsing around a Greenstone collection
  * Searching within a Greenstone collection
  * Leaving the Greenstone digital library
  * Exercise: Use the UNAIDS collection to answer these questions
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/IITE_cdrom.htm|Working with a pre-packaged collection (Digital Libraries in Education)]]**    
  * Installing a pre-packaged collection
  * Browsing around a Greenstone collection
  * Exercise: Read the Help page; then answer these questions
  * Exercise: Use the How to build a digital library collection to answer these questions.
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/install_greenstone.htm|Installing Greenstone]]**
  * Installing Greenstone on a Windows system
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/update_greenstone_installation.htm|Updating a Greenstone installation]]**
  * Removing Greenstone from a Windows system
  * Reinstalling Greenstone on a Windows system
  * Amalgamating different Greenstone collections
-->
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/small_html_collection.htm|Building a small collection of HTML files]]**
  * Running the Greenstone Librarian Interface
  * Starting a new collection
  * Adding documents to the collection
  * Building the collection
  * Viewing the extracted metadata
  * Viewing the internal links and external links
  * Setting up a shortcut in the Librarian interface
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/simple_image_collection.htm|A simple image collection]]**
  * Adding Title and Description metadata
  * Change Format Features to display new metadata
  * Changing the size of image thumbnails
  * Adding a browsing classifier based on Description metadata
  * Creating a searchable index based on Description metadata
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/word_pdf_collection.htm|A collection of Word and PDF files]]**
  * Viewing the extracted metadata
  * Manually adding metadata to documents in a collection
  * Document Plugins
  * Search indexes
  * Browsing classifiers
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/formatting_word_pdf.htm|Formatting the Word and PDF collection]]**
  * Tidying up the default format statement
  * Linking to Greenstone version or original version of documents
  * Making bookshelves show how many items they contain
  * Displaying multi-valued metadata
  * Advanced multi-valued metadata
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/pdfbox-extension.htm|Processing newer versions of PDF with PDFBox]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/enhanced_pdf.htm|Enhanced PDF handling]]**
  * Modes in the Librarian Interface
  * Splitting PDFs into sections
  * Using image format
  * Using process_exp to control document processing (advanced)
  * Opening PDF files with query terms highlighted
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/enhanced_word.htm|Enhanced Word document handling]]**
  * Using Windows native scripting
  * Modes in the Librarian Interface
  * Defining styles
  * Removing pre-defined table of contents
  * Extracting document properties as metadata
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/associated_files.htm|Associated files: combining different versions of the same document together]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/export_to_CDROM.htm|Exporting a collection to CD-ROM/DVD]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/large_html_collection.htm|A large collection of HTML files—Tudor]]**

  * Extracting more metadata from the HTML
  * Looking at different views of the files in the Gather and Enrich panels
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/enhanced_html_collection.htm|Enhanced collection of HTML files—Tudor]]**
  * Adding hierarchically-structured metadata and a Hierarchy classifier
  * Adding a hierarchical phrase browser (PHIND)
  * Partitioning the full-text index based on metadata values
  * Controlling the building process
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/formatting_tudor.htm|Formatting the HTML collection—Tudor]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/section_tagging.htm|Section tagging for HTML documents]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/downloading_from_internet.htm|Downloading files from the web]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/web_linking.htm|Pointing to documents on the web]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/bibliography_collection.htm|Bibliographic collection]]**

  * Using fielded searching
  * Exploding the database
  * Reformatting the collection to use the exploded metadata
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/cds_isis.htm|CDS/ISIS collection]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/using_macro_files.htm|Customization: macro files and stylesheets]]**

  * Collection specific customisation
  * Changing the colour of the page title and page text
  * Make your own Greenstone home page
  * How to determine which images to replace (advanced)
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/multimedia_collection_explore.htm|Looking at a multimedia collection]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/multimedia_collection_build.htm|Building a multimedia collection]]**

  * Manually correcting metadata
  * Browsing by media type
  * Suppressing dummy text
  * Using AZCompactList rather than List
  * Making bookshelves show how many items they contain
  * Adding a Phind phrase browser
  * Branding the collection with an image
  * Using UnknownPlugin
  * Cleaning up a title browser using regular expressions
  * Using non-standard macro files
  * Using different icons for different media types
  * Changing the collection's background image
  * Building a full-size version of the collection
  * Adding an image collage browser
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/scanned_image_collection.htm|Scanned image collection]]**

  * Grouping documents by series title and displaying dates within each group
  * Browsing documents by Date.
  * Displaying scanned images and suppressing dummy text
  * Searching at page level
  * Tidying up search results
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/advanced_scanned_image_collection.htm|Advanced scanned image collection]]**

  * Adding another newspaper to the collection
  * XML based item file
  * Using process_exp to control document processing
  * Switching between images and text
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/OAI_collection.htm|Open Archives Initiative (OAI) collection]]**

  * Tweaking the presentation with format statements

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/GS_OAI_server.htm|Setting up your Greenstone OAI Server]]**
  * Validating the Greenstone OAI server

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/OAI_downloading.htm|Downloading over OAI]]**

  * Downloading using the Librarian Interface
  * Downloading using the command line

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/METS_export.htm|Use METS as Greenstone's Internal Representation]]**

**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/dspace_to_greenstone.htm|Moving a collection from DSpace to Greenstone]]**

  * Adding indexing and browsing capabilities to match DSpace's
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/greenstone_to_dspace.htm|Moving a collection from Greenstone to DSpace]]**

  * Using Greenstone from the command line
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/gems.htm|Editing metadata sets]]**

  * Running GEMS
  * Creating a new metadata set
  * Adding a new element to a metadata set
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/indexers.htm|Building and searching with different indexers]]**

  * Build with Lucene
  * Search with Lucene
  * Build with MGPP
  * Search with MGPP
  * Use search mode hotkeys with query term
  * A quick reference of the search mode hotkeys in MGPP
**[[http://wiki.greenstone.org/gsdoc/tutorial/gs2-current/en/depositor.htm|Incremental building of a collection]]**

  * The Depositor
  * Enabling The Depositor
  * Setting a user group
  * Use the Depositor to do incremental addition
  * Batch addition with the Depositor
</TAB>


</TABAREA>
<!--
USING THE ICECITE TOOL TO CONVERT FROM PDF TO TXT

1. Need Java 8 for compiling and probably also for running Icecite
<code>
export JAVA_HOME=/opt/java8/
export PATH=$JAVA_HOME/bin:$PATH
</code>

2. Get and compile icecite, following the instructions at https://github.com/ckorzen/icecite
<code>
git clone https://github.com/ckorzen/icecite.git --recursive
cd icecite
git pull --recurse-submodules
cd pdf-parent/
mvn install
</code>

3. Run icecite, general instructions at https://github.com/ckorzen/icecite
<code>
cd ../../
cd icecite/pdf-cli
java -jar target/pdf-cli-*-jar-with-dependencies.jar [options] <input> [<output>]
</code>
Examples:
	greenstone@bedrock:~/icecite/pdf-cli$ java -jar target/pdf-cli-0.0.1-SNAPSHOT-jar-with-dependencies.jar --format txt --feature words ~/Downloads/A9-access-best-practices.pdf ~/Desktop/iceciteconverted1.txt

	greenstone@bedrock:~/icecite/pdf-cli$ java -jar target/pdf-cli-0.0.1-SNAPSHOT-jar-with-dependencies.jar --format txt --feature lines ~/Downloads/A9-access-best-practices.pdf ~/Desktop/iceciteconverted2.txt

	greenstone@bedrock:~/icecite/pdf-cli$ java -jar target/pdf-cli-0.0.1-SNAPSHOT-jar-with-dependencies.jar --format txt --feature paragraphs ~/Downloads/A9-access-best-practices.pdf ~/Desktop/iceciteconverted3.txt

(Also tried with input file pdf01.pdf from the Reports collection)


4. If you see the exception
---
Exception in thread "main" java.lang.NoClassDefFoundError: org/bouncycastle/jce/provider/BouncyCastleProvider
	at org.apache.pdfbox.pdmodel.encryption.PDEncryption.<init>(PDEncryption.java:96)
	at org.apache.pdfbox.pdfparser.PDFParser.prepareDecryption(PDFParser.java:282)
	at org.apache.pdfbox.pdfparser.PDFParser.initialParse(PDFParser.java:199)
	at org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:249)
	at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:847)
	at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:803)
	at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:757)
	at parser.pdfbox.core.PdfStreamEngine.processFile(PdfStreamEngine.java:120)
	at parser.pdfbox.PdfBoxParser.parse(PdfBoxParser.java:44)
	at cli.PdfParserCommandLine.parse(PdfParserCommandLine.java:268)
	at cli.PdfParserCommandLine.processFile(PdfParserCommandLine.java:247)
	at cli.PdfParserCommandLine.process(PdfParserCommandLine.java:233)
	at cli.PdfParserCommandLine.main(PdfParserCommandLine.java:168)
Caused by: java.lang.ClassNotFoundException: org.bouncycastle.jce.provider.BouncyCastleProvider
	at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 13 more

---

Then:
a. Obtain bouncycastle (encryption?) jar files from https://www.bouncycastle.org/latest_releases.html

Download both jar files listed under the "Provider" column for row "JDK 1.5 - JDK 1.8" (not sure that both are necessary) and put them in icecite/pdf-cli folder (for example)

b. Then see https://stackoverflow.com/questions/15930782/call-java-jar-myfile-jar-with-additional-classpath-option
for how to run a java programme when you have multiple jar files on classpath, as you can't run java with both -cp and -jar.

greenstone@bedrock:~/icecite/pdf-cli$ java -classpath '.:/home/greenstone/icecite/pdf-cli/*:target/pdf-cli-0.0.1-SNAPSHOT-jar-with-dependencies.jar' cli.PdfParserCommandLine --format txt --feature words ~/Desktop/24.pdf ~/Desktop/24converted.txt
-->