v0.13.1

Enzyme v0.13.1

Diff since v0.13.0

Merged pull requests:

• Try llvm.jl 9.1 (#1857) (@wsmoses)
• Fix enzymetestutils tests (#1858) (@wsmoses)

v0.13.0

Enzyme v0.13.0

Diff since v0.12.36

Merged pull requests:

• adjustments to the latest inlining interface changes (#1350) (@aviatesk)
• more comprehensive unit tests for gradient and jacobian (#1773) (@ExpandingMan)
• Suggest workaround in error for overwritten active by ref (#1791) (@danielwe)
• Consider constant fp in runtime activity (#1797) (@wsmoses)
• Fix custom active reverse mode check (#1798) (@wsmoses)
• Look for more writebarrier opportunities (#1800) (@wsmoses)
• Restrict version to 1.10+ (#1809) (@wsmoses)
• Fix MixedDuplicated ABI error on primalerror (#1815) (@wsmoses)
• Runtime activity in mode (#1816) (@wsmoses)
• Ensure typeof doesn't get cached (#1826) (@wsmoses)
• Improve deferred error message (#1827) (@wsmoses)
• Fix diffuse rooting (#1829) (@wsmoses)
• Fix nightly precompile (#1830) (@wsmoses)
• Update Project.toml (#1831) (@wsmoses)
• Move return primal into forward mode (#1832) (@wsmoses)
• Fix rand set (#1833) (@wsmoses)
• Jitrules batched fn (#1835) (@wsmoses)
• Force usage of full typetree on copy/memset (#1838) (@wsmoses)
• Auto upgrade to autodiff_deferred in nested AD (#1839) (@wsmoses)
• Autodiff with do blocks (#1840) (@wsmoses)
• Update sugar apis (#1844) (@wsmoses)
• Simplify deferred functions (#1849) (@wsmoses)
• Use namedtuple for grad/jacobian (#1850) (@wsmoses)
• Add within autodiff cmd (#1851) (@wsmoses)

Closed issues:

• autodiff_deferred with derivatives of order greater than 2 (#1173)
• Minimal CUDA version for Lux Dense Layer (#1442)
• Computing third order derivatives (#1707)
• recent jacobian changes break StaticArrays (#1714)
• sqrt(sum(f, x)) triggers mismatched activity error in forward over reverse (#1794)
• Oceananigans segfault (#1799)
• Error: "task switch not allowed from inside staged nor pure functions" (#1804)
• Forward mode gradient AssertionError (#1807)
• Error: task switch not allowed from inside staged nor pure functions (#1808)
• Move runtime activity into mode parameter (#1810)
• Minimalist StackOverflow in Reverse mode (#1814)
• AD through ODE solution (#1818)
• constant memory now breaking static arrays (#1822)
• ifelse on NaN causing NaN in the reverse path (#1842)
• Readme image is broken (#1846)
• Tuple returns: forward vs reverse (#1847)
• Write analysis pass on autodiff vs autodiff_thunk (#1854)

v0.12.36

Enzyme v0.12.36

Diff since v0.12.35

Merged pull requests:

• Implement set_err_if_func_written for ReverseModeSplit (#1722) (@gdalle)
• Fix GPU errors (#1774) (@wsmoses)
• Fix type error (#1775) (@wsmoses)
• Fix julia select mixed activity (#1776) (@wsmoses)
• Fix readonly on julia 1.11 (#1777) (@wsmoses)
• Fix select index offset (#1778) (@wsmoses)
• Add forward mode svec_ref (#1782) (@wsmoses)
• Handle batch closures (#1784) (@wsmoses)
• Do write barrier after mixed duplicated allocation upgrade (#1785) (@wsmoses)
• CompatHelper: bump compat for Enzyme_jll to 0.0.148, (keep existing compat) (#1787) (@github-actions[bot])
• Improve zero-set location error (#1788) (@wsmoses)
• Add names to object emission (#1789) (@wsmoses)

Closed issues:

• Support for CUDA.jl CuArrays? (#144)
• Runtime activity required for invoke (#407)
• Add support for ENABLE_JITPROFILING for both perf and Vtunes (#633)
• Implementation in DynamicExpressions.jl (#810)
• Multiple issues when using a global variable (#1313)
• Jacobian has wrong shape for matrix input (#1332)
• getting a minimal Lux example working (with CUDA) (#1392)
• Question about functions that return the same argument they mutate, with different activities for the return and the argument (#1411)
• Really long error on julia 1.11 (#1748)
• Forward-over-reverse: hyperbolic functions trigger MethodError: no method matching is_concrete_tuple(::LLVM.LLVMDouble) (#1772)
• Better Error for invertedReturn->getType() == gutils->getShadowType(call.getType()) (#1779)
• unhandled forward for jl_f__svec_ref (#1780)
• BatchDuplicated on functions (#1783)

v0.12.35

Enzyme v0.12.35

Diff since v0.12.34

Merged pull requests:

• fix: conditionally define typetree_inner for BFloat16 (#1759) (@avik-pal)
• Handle deepcopy of constant (#1765) (@wsmoses)
• Manual report exception for cuda (#1766) (@wsmoses)
• Bump LLVM.jl version (#1767) (@wsmoses)
• Loosen runtime activity errors (#1768) (@wsmoses)
• Nancheck for GPU (#1770) (@wsmoses)

Closed issues:

• import_frule / import_rrule docs don't appear (#1452)
• including LoopVectorization causes enzyme to segfault or mutate inputs its not supposed to (#1756)
• Forward-over-reverse: Typtree failure on <4 x {} addrspace(10)*> (#1762)

v0.12.34

Enzyme v0.12.34

Diff since v0.12.33

Merged pull requests:

• WIP: Add internal reverse-mode rules for ranges (#1656) (@ChrisRackauckas)
• Fix jlcall error handler (#1757) (@wsmoses)
• fix LLVM 8 depwarns (#1758) (@isaacsas)

Closed issues:

• floatrange causes "unkown" binary operator (#274)
• Reverse mode jacobian is wrong for matrix input (#1391)
• Integers not treated as const (#1763)
• Function argument passed to autodiff cannot be proven readonly. (#1764)

v0.12.33

Enzyme v0.12.33

Diff since v0.12.32

Merged pull requests:

• Fix cpu features (#1744) (@wsmoses)
• Try diferent name for gpu exception (#1746) (@wsmoses)
• Handle const addr casts (#1752) (@wsmoses)
• Clarify use cases for DuplicatedNoNeed (#1753) (@danielwe)
• Fix multidim solve (#1754) (@wsmoses)
• Type unstable custom rule tape (#1755) (@wsmoses)

Closed issues:

• EnzymeVJP failed when training Neural ODE with DiscreteCallback (#1743)
• CUDA.jl CI broken again because of Enzyme (#1745)
• 'sensealg=InterpolatingAdjoint(autojacvec=EnzymeVJP(), checkpointing=true) ' failed (#1749)
• left division with two matrices (#1750)
• Mixed activity error for 2nd order diff of fused broadcast into preallocated array (#1751)

v0.12.32

Enzyme v0.12.32

Diff since v0.12.31

Merged pull requests:

• small fix for static array onehot (#1732) (@ExpandingMan)
• Fix cuda tape type (#1737) (@wsmoses)
• Fix return diffe (#1740) (@wsmoses)
• Update Project.toml (#1742) (@wsmoses)

Closed issues:

• LLVM error (#1693)
• Enzyme doesn't work for AdvancedVI Part VIII: FP32 + Base.Fix1 ignores gradients (#1735)
• Update broke CUDA.jl downstream CI (#1736)

v0.12.31

Enzyme v0.12.31

Diff since v0.12.30

Merged pull requests:

• chore: bump jll to 0.0.144 (#1731) (@avik-pal)

Closed issues:

• Error in forward over reverse differentiation (KeyError: key not found) (#1713)

v0.12.30

Enzyme v0.12.30

Diff since v0.12.29

Merged pull requests:

• Precompilation simplification (#1715) (@wsmoses)
• Mark gc preserve as readonly (#1724) (@wsmoses)
• fix: BFloat16 extension and tests (#1725) (@avik-pal)
• boxfloat fixup (#1726) (@wsmoses)
• Unhash the jl_idtable_rehash call (#1727) (@wsmoses)
• More bfloat fix (#1728) (@wsmoses)
• Update compiler.jl (#1729) (@wsmoses)

Closed issues:

• LLVM error (#1693)
• Function argument passed to autodiff cannot be proven readonly (#1719)
• Error in BFloat16 extension (#1720)
• ERROR: LoadError: UndefVarError: BFloat16 not defined (#1723)

v0.12.29

Enzyme v0.12.29

Diff since v0.12.28

Merged pull requests:

• fix: typetree_inner is not in Compiler module (#1716) (@avik-pal)
• Fix doctests, remove Formatter CI, add caching to Documenter CI (#1721) (@vchuravy)