tests for AD using dual numbers

[papamarkou]

@mlubin I open this issue as a placeholder - I will start organizing the tests in ForwardDiff this weekend. Would you like to take care of adding some tests for forward mode AD based on dual numbers to share the workload? :)

[mlubin]

Sure, I can take a look at this.

By the way, is there any reason to not support Julia 0.2 right now? REQUIRE currently has julia 0.3-.

[papamarkou]

Yes, we should support Julia 0.2 as well. It is just my bad habit to work only with the latest build. Let's change REQUIRE in the next commit.

[kmsquire]

@StefanKarpinski, just to verify: does the Pkg code care if supported versions of a package are sequential?

[mlubin]

If it does, we can just clear the old versions from METADATA.

[StefanKarpinski]

It won't let you use it to tag things non-sequentially, but if you tag by hand, it will work. You can also clear older versions.

[mlubin]

I renamed autodiff to something more descriptive and added a few tests for this.

[papamarkou]

That's great Miles, the dual_fad name that you chose seems better indeed. Thanks for adding the tests! Shall we close this issue?

[mlubin]

Sure

[papamarkou]

@mlubin, following your preferred style of your code, I generalized the interface and put it in the api.jl file. Your code is nearly intact, I only had to make a couple of arguments optional so that they can interact with the generic API functions. Things start looking much more functional now... I also made tensor FAD possible, but will need some more work to overload more functions other than +,-,* (will do this).