Monday, February 14, 2011

Reverse sort dropdown values in a GSP page

In a GSP page in a Grails application, it is easy to sort values in a dropdown in ascending order. Just pass a closure to sort() call with the name of the attribute to sort by.

  • ${i.name}

  • It is just as easy to sort in descending order. Just provide a sort closure with 2 parameters and return 1 or -1 as in a Comparator.compare() method.
    
    
  • ${i.name}
  • ... or see Tom's post below.

    Monday, January 31, 2011

    Extracting IP addresses from DiG output for a bunch of hosts

    In my Grails server inventory app, I had to account for future IP space refactoring, where a bunch of hosts would change their IP addresses. All users of the system will expect to see new IPs in all runbooks, so something had to be done to keep them in sync.

    So, I decided to add a Quartz job that would

    1. Query all existing hosts with a valid host name
    2. Call a 'dig' on that host
    3. Parse an IP address from dig response

    So, let's say we have a Host object that looks something like this:

    class Host {
        ...
        String hostName
        String ipAddress
        ...
    }
    

    Adding a Quartz job is a trivial task that can be easily accomplished using grails Quartz plugin. One advice: use the Quartz plugin instead of manually adding a TimerTask bean using resources.groovy. Apparently, Grails application's most vital aspects, such as autowiring of services and GORM Hibernate session are not available at construction time for beans defined in resources.groovy, because those beans are read before anything in grails-app directory. So, here's how my Quartz job looks in a Grails 1.3.4 application:

    import org.codehaus.groovy.grails.commons.ApplicationHolder
    
    class IpSynchJob {
        def hostService
        def startDelay
        def timeout
    
        public IpSynchJob() {
            startDelay = 0
            timeout = ApplicationHolder.application.config.timer.ipsynch.interval
        }
    
    
        def execute() {
            def hosts = Host.createCriteria().list {
                isNotNull("hostName")
            }
    
            hosts.each { host ->
                log.info "synching IP for hostname $host.hostName"
                synchIp(host)
            }
        }
    
        void synchIp(host) {
            def dig = digServer(host.hostName)
            def ipAddress = parseIpFromDigOutput(dig)
            host.ipAddress = ipAddress
            host.save()
        }
    
        String parseIpFromDigOutput(digOutput) {
    
            // looking for IP address in dig's answer section using positive lookahead
            def ipInDigPtn = /(ANSWER SECTION\:)(?=\n.*IN\s+A\s+(\d+\.\d+\.\d+\.\d+))/
            def ip
            digOutput.eachMatch(ipInDigPtn) { match ->
                ip = match[2]
            }
            return ip
        }
    
        String digServer(hostName) {
            Process p = "dig $hostName".execute()
            int initCapacity = 4096
            StringBuffer out = new StringBuffer(initCapacity)
            p.consumeProcessOutput(out, out)
            // maxing out wait at 20 seconds
            p.waitForOrKill(20000)
    
            return out.toString()
        }
    }
    

    Tuesday, January 4, 2011

    functional-test plugin is broken in Grails 1.3.x versions

    Got around to write some functional tests for the Grails app i'm working on. "Grails in Action" book recommends functional-test plugin, and it looks like it's pretty popular in the community, but it appears that it doesn't work for Grails 1.3.x versions. And since grails-plugins code hasn't been touched since July, it only makes sense to switch to something else at the moment.

    Thursday, December 16, 2010

    Curried closures and static methods

    If the same static utility method is called from multiple places in Groovy code, and some of the parameters to the method are always the same, curried closure is a nice way to shorten the syntax. For instance, the following static method retrieves all the entries from a list that match a certain pattern:


    class MatchHelper {
        static List getMatches(pattern, list) {
            list.grep(pattern)
        }
    }
    

    Method getMatches is then called from several places in the code:

    def pattern = ~/^[Tt].*/
    ...
    List cars = ["Murano", "Touareg", "Taurus"]
    List matchedCars = MatchHelper.getMatches(pattern, cars)
    assert  ["Touareg", "Taurus"] == matchedCars
    ...
    List veggies = ["Tomato", "Broccoli", "Sprout"]
    List matchedVeggies = MatchHelper.getMatches(pattern, veggies)
    assert ["Tomato"] == matchedVeggies
    ...
    List cities = ["Torino", "Sydney", "Tegucigalpa"]
    List matchedCities = MatchHelper.getMatches(pattern, cities)
    assert ["Torino", "Tegucigalpa"] == matchedCities
    

    Not only does each code snippet calls MatchHelper.getMatches(), but also ~/^[Tt].*/ is passed as the first parameter each time. Instead the code can be shorted this way:

    def getTMatches = MatchHelper.&getMatches.curry(~/^[Tt].*/)
    ...
    List cars = ["Murano", "Touareg", "Taurus"]
    List matchedCars = getTMatches(cars)
    assert  ["Touareg", "Taurus"] == matchedCars
    ...
    List veggies = ["Tomato", "Broccoli", "Sprout"]
    List matchedVeggies = getTMatches(veggies)
    assert ["Tomato"] == matchedVeggies
    ...
    List cities = ["Torino", "Sydney", "Tegucigalpa"]
    List matchedCities = getTMatches(cities)
    assert ["Torino", "Tegucigalpa"] == matchedCities
    

    A little less code and a little more elegance. Typical Groovy.

    Friday, December 3, 2010

    Properly defining integration tests in Maven POM

    By default, Maven executes all tests during test phase, no matter if the class name ends with 'Test' or 'IntegrationTest'. So, unless integration tests are placed in a separate module (which is not a bad idea at all), some POM crafting is required to make sure that unit tests execute during test phase and integration tests execute during integration-test phase. There are 2 ways to do that:

    1. Maven surefire plugin

    Maven uses this plugin by default for all test runs. So no special configuration is needed to run unit tests. This is what needs to be added for integration tests:


    <build>
        <plugins>
             ...
            <plugin>
                 <groupId>org.apache.maven.plugin</groupId>
                 <artifactId>maven-surefire-plugin</artifactId>
                 <configuration>
    
                      <!-- at first, all integration tests need to be explicitly excluded 
                             from all test executions, be it test phase 
                             or any other phase where maven-surefire-plugin is invoked 
                             on a custom basis.
                         -->
                      <excludes>
                          <exclude>**/*IntegrationTest.java</exclude>
                      </excludes>
    
                  </configuration>
                  <executions>
                      <execution>
                          <id>integration-test</id>
                          <goals>
                              <goal>test</goal>
                          </goals>
                          <phase>integration-test</phase>
                          <configuration>
    
                              <!-- Here integration tests are included 
                                     at the integration-test phase separately.
                                  -->
                              <includes>
                                  <include>**/*IntegrationTest.java</include>
                              </includes>
                              <!-- a parameter called 'skipIntegration' is
                                     the same as 'skipTests' except only
                                     for integration tests -->
                              <skipTests>${skipIntegration}</skipTests>
                          </configuration>
                      </execution>
                  </executions>
               </plugin>
               ...
          </plugins>
    </build>
    

    2. Maven failsafe plugin

    This maven plugin includes integration test classes whose names fit '*IT' or '*ITCase' patterns and executes them during integration-test phase. If classes are named that way, then it's enough to simply throw in default maven-failsafe-plugin configuration. However, if classes are named using '*IntegrationTest' pattern, then they have to be excluded from test phase in maven-surefire-plugin configuration, and that pattern has to be defined in maven-failsafe-plugin configuration:

    <build>
        <plugins>
             ...
            <plugin>
                 <groupId>org.apache.maven.plugin</groupId>
                 <artifactId>maven-surefire-plugin</artifactId>
                 <configuration>
                      <excludes>
                          <exclude>**/*IntegrationTest.java</exclude>
                      </excludes>
                 </configuration>
             </plugin>
    
             <plugin>
                 <groupId>org.apache.maven.plugins</groupId>
                 <artifactId>maven-failsafe-plugin</artifactId>
                 <configuration>
                     <includes>
                         <include>**/*IntegrationTest.java</include>
                      </includes>
    
                      <skipTests>${skipIntegration}</skipTests>  
                  </configuration>
                  <executions>
                      <execution>
                          <id>integration-test</id>
                          <phase>integration-test</phase>
                          <goals>
                              <goal>integration-test</goal>
                          </goals>
                      </execution>
                      <execution>
                          <id>verify</id>
                          <phase>verify</phase>
                          <goals>
                              <goal>verify</goal>
                          </goals>
                      </execution>
                  </executions> 
              </plugin>    
             ...
         </plugins>
    </build>
    

    Wednesday, November 24, 2010

    Maven versions plugin breaks when version number is inherited from parent

    In release management cycle, it is common to force a version number on to maven POM before the artifact is deployed to maven repository. This type of situation arises when, for instance, releases are managed by Continuous Integration tools, such as Cruise Control, Hudson, or Anthill Pro, and it feels redundant to have to go into source code, manually update version number in the POM and commit it. If managing entire release is not done via maven release plugin, then maven versions plugin can come in handy to just set the version number:

    mvn versions:set -DnewVersion=1.0.0

    There is one nuance though. In some cases, project version is inherited from parent, and project's POM uses parent POM, like this:

    <parent>
        <groupId>com.company</groupId>
        <artifactId>company-parent</artifactId>
        <version>1.0</version>
        <relativePath>../company-parent/pom.xml</relativePath>
    </parent> 
    

    In this case for a local maven build, version does not have to be defined in POM as it will be 2.0, the version number of parent. However, the mvn versions:set command will result in error with the following message:


    [ERROR] BUILD ERROR
    [INFO] ------------------------------------------------------------------------
    [INFO] Project version is inherited from parent.

    Thus, some version has to be added to the project. If project still has to have parent version for some reason, then just copy version from inside parent tag. Otherwise, just go with any valid version number.

    Monday, October 11, 2010

    Using your application classes inside Grails Gant script

    So you have a Grails application, and want to script some cool things on top of it, like calling your RESTful service, using dynamic finders on domain classes, or adding new records using Hibernate. No surprise, there are some caveats that await for you on the way. Let's see what they are:

    1. Loading your application context

    This is an obvious first step, and this is what Grails expects you to do:

    includeTargets << grailsScript("_GrailsBootstrap")   
    target(main: "My Gant script") {       
        depends(configureProxy, packageApp, classpath, loadApp, configureApp, compile)       
        ...  
    }   
    setDefaultTarget("main")   
    

    Yep, all these parts of depends() clause are needed, although "compile" part is needed only if domain objects are directly used, i.e., MyDomainClass.findByAttr().

    2. Setting target environment

    Two ways to do that. Standard grails way:

    grails prod my-script    - for environments pre-defined in Grails, such as 'dev' or 'prod'
    grails -Dgrails.env=stage my-script     - for custom environments

    or place this at the beginning of your script:

    scriptEnv = "envName"
    and then simply run
    grails my-script

    3. Accessing your application classes and calling methods on them

    The following example shows how to call a service method in your Gant script.
    def serviceClass = grailsApp.getClassForName("com.killerapp.AwesomeService")
    def serviceClassMethod = serviceClass.metaClass.getMetaMethod("blazingMethod")
    def service = appCtx.getBean("awesomeService")
    serviceClassMethod.invoke(service, [arg1, arg2] as Object[])
    

    As seen in the example, there are 2 implicit variables that the script provides: "grailsApp" and "appCtx". First one is an instance of org.codehaus.groovy.grails.commons.GrailsApplication, and the second one is an instance of org.springframework.context.ApplicationContext. To call a service method, both are needed: grailsApp helps retrieve an instance of MetaMethod wrapper of the method you want to call. However, MetaMethod has to be called on a specific instance, which is Spring context singleton that Grails application creates when it initializes. appCtx helps retrieve that singleton. 
    However, this is not enough. Your service method has to be defined as an actual method, like this:

    void blazingMethod(arg1, arg2) {
          ...
    }
    
    , NOT a closure:
    def blazingMethod { arg1, arg2 ->
          ...
    }
    

    That is because groovy closures are compiled into non-anonymous inner classes, not regular Java methods. Therefore, accessing closures by name will not work.


    4. Running queries

    To run dynamic finders, nothing extra needs to be done:

    MyDomainClass.findByName("someName")

    To run updates, an instance of org.springframework.orm.hibernate3.HibernateTemplate is needed. It can be obtained using appCtx:

    def sessionFactory = appCtx.getBean("sessionFactory")
    def template = new HibernateTemplate(sessionFactory)
    def newRecord = new MyDomainClass(name: "someName")
    template.saveOrUpdate(newRecord)
    

    HibernateTemplate can also be used for queries, like this:
    def domainClass = grailsApp.getClassForName("com.killerapp.MyDomainClass")
    def allRecords = template.loadAll(domainClass) 
    

    5. Cleaning script cache

    As of Grails 1.3.4, using depends(compile) with accessing domain classes in a Gant script generates the following error simply running a script once, then making a change and re-running it:

    java.lang.NoClassDefFoundError: com.killerapp.MyDomainClass

    This is because scriptCache needs to be cleaned. Simply delete ~/.grails/1.3.4/projects/killerApp/scriptCache/ directory, and rerun the script.