https://wiki.geneontology.org/api.php?action=feedcontributions&user=Miyasato&feedformat=atomGO Wiki - User contributions [en]2024-03-28T22:46:51ZUser contributionsMediaWiki 1.40.0https://wiki.geneontology.org/index.php?title=AmiGO_2_Manual:_Overview&diff=61302AmiGO 2 Manual: Overview2016-07-27T21:07:28Z<p>Miyasato: </p>
<hr />
<div>= Introduction =<br />
<br />
AmiGO 2 is a project to create the next official web-based set of tools for searching and browsing the Gene Ontology database, which consists of a controlled vocabulary of terms covering biological concepts, and a large number of genes or gene products whose attributes have been annotated using GO terms.<br />
<br />
The most current installation of this software is at the [http://amigo.geneontology.org public] site.<br />
<br />
While we are getting the new documentation sorted out, plase take a look at the pages in [[:Category:AmiGO_2_Manual]].<br />
<br />
More technical information about AmiGO 2 can be found [[AmiGO_2 | here]].<br />
<br />
= Installation =<br />
<br />
The current installation docs can be found [[AmiGO_2_Manual:_Installation | here]].<br />
<br />
= Components =<br />
<!-- Inserting comment to test editing capability --><br />
== Home ==<br />
<br />
[[AmiGO_2_Manual:_Home | Home]] allows simple quick searches using autocomplete and the new [[GOlr]] backend.<br />
<br />
== Search ==<br />
<br />
[[AmiGO_2_Manual:_Search | Search]] interactively searches and filters the GO data as you type. Also allows you to use a powerful search syntax (including boolean operators). <br />
<br />
[[AmiGO_2_Manual:_Search_Examples | Examples workflows]] are also documented.<br />
<br />
== Term Page ==<br />
<br />
[[AmiGO_2_Manual:_Term_Page | Term]] pages contain common information about GO terms and their annotations.<br />
<br />
== Gene Product Page ==<br />
<br />
[[AmiGO_2_Manual:_Gene_Product_Page | Gene product]] pages contain common information about gene product and their annotations.<br />
<br />
== Grebe ==<br />
<br />
The [[AmiGO_2_Manual:_Grebe | Grebe]] search wizard can be used to quickly answer common questions using a fill-in-the-blank approach. <br />
<br />
== Visualize ==<br />
<br />
[[AmiGO_2_Manual:_Visualize | Visualize]]s the GO graph. Freely make your own ontology graph, including label and color changes. Please see the documentation for more details.<br />
<br />
== GOOSE ==<br />
<br />
[[AmiGO_2_Manual:_GOOSE | GOOSE]] is the GO Online SQL Environment. Using this, users may query the GO database directly using SQL, or edit one of the already made templates. <br />
<br />
<br />
<br />
[[Category:Software]]<br />
[[Category:AmiGO_2_Manual]]<br />
[[Category:AmiGO_2]]</div>Miyasatohttps://wiki.geneontology.org/index.php?title=GOlr:_Installation&diff=56659GOlr: Installation2015-04-20T23:41:52Z<p>Miyasato: </p>
<hr />
<div>These instructions are intended to illustrate how to install the GOlr server software for AmiGO 2 on a Ubuntu 12.04 LTS Desktop. With careful reading, these instructions should be generalizable to other cases.<br />
<br />
= General notes =<br />
<br />
The following packages are required:<br />
<br />
* openjdk-6-jdk (although be believe Java 7 might be an option for OWLTools)<br />
* jetty<br />
* subversion<br />
<br />
Jetty will need to be setup to start and listen to an external address if you want.<br />
<br />
Also, you will need a version of Maven 3 (mvn) to use and build OWLTools if you are trying to load data or produce a schema--the one in Ubuntu for 12.04 is stuck at Maven 2 and not compatible. It is a fairly simple process to download it and make sure that it is in your path.<br />
<br />
mkdir -p ~/local/src/java<br />
cd ~/local/src/java<br />
wget http://apache.cs.utah.edu/maven/maven-3/3.0.4/binaries/apache-maven-3.0.4-bin.tar.gz<br />
tar -zxvf apache-maven-3.0.4-bin.tar.gz<br />
<br />
Now just make sure that either ~/local/src/java/apache-maven-3.0.4/bin is in your path or explicitly call ~/local/src/java/apache-maven-3.0.4/bin/mvn each time. You'll probably want to add something like:<br />
<br />
JAVA_HOME=/usr/lib/jvm/java-6-openjdk<br />
PATH="${PATH}":"${HOME}"/local/src/java/apache-maven-3.0.4/bin<br />
<br />
To your ~/.bashrc.<br />
<br />
Also, the default shell limit for maximum user processes may be too small to build OWL tools. In particular, on Ubuntu 14.04, this value is set to 1024. It may be necessary to raise this limit by adding the following line to your .bashrc file:<br />
<br />
<code>ulimit -u unlimited</code><br />
<br />
Then refresh:<br />
<br />
source ~/.bashrc<br />
<br />
=Readying OWLTools=<br />
<br />
First, we need to download and build OWLTools--it contains the loader code that GO uses for ontology and GAF files, as well as the tools to generate a new Solr schema from AmiGO 2 YAML config files. The code should be self-sufficient and easy to build on a machine with an internet connection.<br />
<br />
Please keep in mind that there is really '''no requirement''' to use these tools to load a Solr instance for use with AmiGO 2--as long as the meta-information exists and the Solr schema is compliant, anything should work. However, it '''is recommended''' that you at least get used to the data workflow with these tools before heading out on your own.<br />
<br />
mkdir -p ~/local/src/svn<br />
cd ~/local/src/svn<br />
svn checkout http://owltools.googlecode.com/svn/trunk/ owltools<br />
<br />
To build:<br />
<br />
cd ~/local/srv/svn/owltools/OWLTools-Parent/ && mvn clean package<br />
<br />
Or, without unit tests (much quicker):<br />
<br />
cd ~/local/src/svn/owltools/OWLTools-Parent/ && mvn clean package -DskipTests<br />
<br />
The ''owltools'' binary should now be built, so you'll probably want to add it to your path by adding the following to your ~/.bashrc:<br />
<br />
PATH="${PATH}":"${HOME}"/local/src/svn/owltools/OWLTools-Runner/bin<br />
<br />
Then refresh:<br />
<br />
source ~/.bashrc<br />
<br />
=Solr with the GO Solr schema (GOlr)=<br />
<br />
==The "Ubuntu" way==<br />
<br />
While we have Jetty installed from the Ubuntu repos, we have our own Solr (3.6, the one that comes with Ubuntu 12.04 is ancient) in the GOlr repo. Let's get that first and look at it; even if we don't use the GOlr repo's supplied schema.xml, some of the information in there can be helpful. All GOlr source is in the AmiGO 2 git repo: amigo/golr. If you have not already done so, get the AmiGO 2 repo.<br />
<br />
mkdir -p ~/local/src/git<br />
cd ~/local/src/git<br />
git clone git://github.com/kltm/amigo.git<br />
cd amigo/golr<br />
<br />
While we can install/handle our Jetty/Solr setup with the Makefile found in this directory, you may find it easier to just look at it and develop your own setup.<br />
<br />
The solr.war for Jetty is at:<br />
<br />
~/local/src/git/amigo/golr/solr/solr.war<br />
<br />
Deploy this with the make command:<br />
<br />
make golr-install<br />
<br />
The heavy rollout lifting is done by the emacs script tools/golr.el.<br />
<br />
Of course, it's important to remember that the most important end product of this section is to be using a correctly organized schema.xml file in a Solr 3.6 setup. However you accomplish that is fine. For example, the schema.xml file used by GO can be found at:<br />
<br />
~/local/src/git/amigo/golr/solr/conf/schema.xml<br />
<br />
Alternatively, you can generate a custom one by making sure that OWLTools is in the right place (check your environment and the Makefile) and running:<br />
<br />
make golr-schema<br />
<br />
Also, the solrconfig.xml file in ~/local/src/git/amigo/golr/solr/conf/ might be also be useful in your setup.<br />
<br />
== The fast-and-dirty(-but-always-works) way==<br />
<br />
Instead of running Solr in a separate Jetty (or Tomcat) server, an alternative is to get a standalone embedded instance of Solr running.<br />
# Download the latest Solr 3.6.x and unzip the archive in the desired folder.<br />
# In the unpacked archive, delete everything under the folder apache-solr-3.6.2/example/solr/conf and copy over the GOlr config files (schema.xml and solrconfig.xml) from amigo/golr/solr/conf/.<br />
# Finally start Solr from the folder apache-solr-3.6.2/example with:<br />
<br />
java -jar start.jar<br />
<br />
=Loading the data=<br />
<br />
More memory is always welcome, but less is probably sufficient. The PANTHER section needs some special care. If you leave the PANTHER flags in the Makefile as they are now, you will need to make sure that they are there. Without checking out the whole (very large) tree, as a GOC member:<br />
<br />
cd ~/local/src/svn<br />
svn checkout svn+ssh://sjcarbon@ext.geneontology.org/share/go/svn/trunk/experimental/trees/panther_data panther_data<br />
mkdir -p ~/local/src/svn/geneontology.org/trunk/experimental/trees/<br />
mv panther_data ~/local/src/svn/geneontology.org/trunk/experimental/trees/<br />
<br />
Or something similar--you just need the tree data in the right spot. These are optional and can be left out entirely if you don't need it.<br />
<br />
As an example, we will use the Makefile profile to do a standard load:<br />
<br />
make load-full<br />
<br />
And that should be it.<br />
<br />
Remember that if you are using a caching server on the frontend that you will need to purge the caches.<br />
<br />
==All Glory to the Makefile (Important!)==<br />
<br />
For some time now, all day-to-day development, handling, distribution, and loading of [[AmiGO_2]] and [[GOlr]] have been handled with the Makefiles in amigo/Makefile and amigo/golr/Makefile respectively. If it cannot be done by changing your environment variables and rerunning the target that you want, you might want to reconsider what you're doing. For example, a quick Solr optimize at a different URL with a lower amount of memory might look like:<br />
<br />
OWLTOOLS_MAX_MEMORY=5G SOLR_URL=http://localhost:9000/solr/ make load-optimize<br />
<br />
While the Makefiles are not yet fully documented (will add them to our NaturalDocs real soon now), they may be worth perusing. This is issue: https://github.com/kltm/amigo/issues/26<br />
<br />
[[Category:Software]]<br />
[[Category:AmiGO_2]]<br />
[[Category:GOlr]]</div>Miyasato