Status: In Progress · Proposal
June 2026¶
Summary of Work Completed¶
During this period, mainly on-going work for Spark 4 support, and some more CI stabilization
Updated and refactored the build and CI of satellite project ammonite-spark (which brings Spark support to Almond), in order to test and support more Spark versions in the future (alexarchambault
/ammonite -spark #481, alexarchambault /ammonite -spark #487, alexarchambault /ammonite -spark #488, alexarchambault /ammonite -spark #489, alexarchambault /ammonite -spark #491) Moved the lightweight
-spark -distrib repo, used by ammonite-spark, to the Almond organization, and started working on making it support more Spark versions (almond -sh /lightweight -spark -distrib#1) More work on stabilizing Almond’s CI (almond
-sh /almond #1692, almond -sh /almond #1693, almond -sh /almond #1700, almond -sh /almond #1701)
Deliverables/Milestones¶
Nothing to report yet, apart from more stable CIs and updated builds
Challenges or Risks¶
Minor: testing Spark 4 support on the CI when Spark runs on YARN should require emulating a minimal YARN 3 cluster, while the existing tests only emulate a YARN 2 one. But the help of LLMs should greatly lower the time needed to get that working.
Budget Update¶
2.5 days of work done since the last report, so 3.5 days of work done overall, over 39.5 days planned
Next Steps¶
Adding Spark 4 support in ammonite-spark (which provides Spark support in Almond)
Use Almond’s Ammonite fork (set up during the last report period) in Almond itself
April 2026¶
Summary of Work Completed¶
Mainly updates, stabilizing CI, on-going work on bugs and satellite projects
New attempts at working around transient errors on CI (almond
-sh /almond #1661), to streamline automated updates and agent work - somewhat successful, more tweaking to come (almond -sh /almond #1664) work on-going (alexarchambault
/ammonite -spark #481) to update the build of satellite project ammonite-spark, required to fix publishing to Maven Central work on-going to set up a fork of the Ammonite project that Almond relies on (Ammonite’s author deprecated it, as he focuses on Scala 3, and some Ammonite features have been added to the default Scala 3 REPL. In Almond, we still need Scala 2 support, in particular for Spark users, so we need to keep Ammonite alive and maintained.)
Work on-going (almond
-sh /almond #1666) on fix for issue reported by Netflix users (almond -sh /almond #1499)
Deliverables/Milestones¶
Nothing to report yet, work has just started
Challenges or Risks¶
Nothing to report here
Budget Update¶
One day of work over 39.5 days planned
Next Steps¶
Keep updating things and stabilizing CI, reviewing opened issues and trying to get agents to work on issues or explore things to help address them