content/blog/2022/12/hop-2.2.0/index.adoc (92 lines of code) (raw):

--- title: "Apache Hop 2.2 is available!!" date: 2022-12-06T07:49:56+02:00 authors: ["bamaer"] categories: ["2.2", "Release", "Apache Hop"] preview: "Apache Hop 2.2 Released" description: "The latest Apache Hop release 2.2.0 is now available. Let's walk through the most important new features in this release." draft: false --- :imagesdir: ../../../../../static :toc: macro :toclevels: 3 :toc-title: Let's take a closer look at what Hop 2.2 brings: :toc-class: none After almost two months of work on over 160 tickets, the Apache Hop community is pleased to announce the general availability of Apache Hop 2.2.0. + A huge thank you to everyone who made this possible. image::/img/Release-2.2/hop-22.svg[ width="45%"]   + toc::[] or https://hop.apache.org/download/[**download Hop 2.2.0 **] right away. == Hop GUI improvements Hop GUI continues to improve with every release. These are evolutions rather than revolutions, but Apache Hop 2.2.0 comes with **a lot** of evolution in Hop GUI. === Welcome Dialog New Apache Hop users may not know exactly where to start right away. A new welcome dialog (https://issues.apache.org/jira/browse/HOP-4448[HOP-4448^]) in Hop GUI helps new users to get started quickly with links to documentation and samples. This welcome dialog not only introduces a new link plugin type but also allows any plugin in the Hop platform to add their own information to the welcome dialog. image:/img/Release-2.2/hop-gui-welcome.png[Hop GUI - welcome dialog, width=75%] For example, take a closer look at the https://hop.apache.org/manual/latest/pipeline/beam/getting-started-with-beam.html[Apache Beam] tab, that takes you directly to useful documentation links and switches to the Beam pipelines in the samples project. image:/img/Release-2.2/hop-gui-welcome-beam.png[Hop GUI - Apache Beam welcome dialog, width=75%] === A new navigation viewport One of Apache Hop's best practices is to keep https://hop.apache.org/manual/latest/best-practices/index.html#_size_matters[the size] of your pipelines and workflows within reason. However, sometimes your business logic requires more screen real estate than what fits in a single screen. Navigating pipelines and workflows with the horizontal and vertical scroll bars has always been a bit of a painful experience and was hard to get right on the variety of platforms Hop GUI and Hop Web need to support. The viewport (https://issues.apache.org/jira/browse/HOP-4527[HOP-4527^]) in Hop 2.2.0 brings a new way of navigating your pipelines and workflows in Hop GUI and Hop Web: simply drag around in the viewport to move your pipeline up, down, left or right. Additionally, zooming in and out has been improved, with cleaned up and more consistent scrollwheel zooming and `CTRL-+/=` and `CTRL--` to zoom in and out, and `CTRL-0` to return to 100% zoom. image:/img/Release-2.2/hop-gui-viewport.png[Hop GUI - viewport, width=75%] === New data grid toolbars instead of right-click menu When developing or debugging pipelines, Hop users often work with data grids or tables, for example to preview data. A lot of the operations in these grids require operations like cutting, copying and pasting rows, moving rows up or down in a selection and more. The way to perform these actions until Hop 2.1.0 was through the right-click menu on these grids. This isn't always ideal, especially in a Hop Web context. Hop 2.2.0 introduces a new data grid toolbar (HOP-4585 Create toolbar on top of TableView widget https://issues.apache.org/jira/browse/HOP-4585[HOP-4585^]) to allow all these operation at the click of a button. Also notice the last option in the toolbar: it is now possible to export the contents of a grid to Excel (https://issues.apache.org/jira/browse/HOP-4593[HOP-4593^]). TIP: For easy editing of large or advanced data grid, you can copy/paste data grids between Apache Hop and Excel or other spreadsheet platforms in both directions. image:/img/Release-2.2/hop-gui-grid-toolbars.png[Hop GUI - data grid toolbars, width=75%] === Configuration perspective The number of plugins that is added to Apache Hop increases with every release. A lot of these plugins require or allow configuration. To avoid littering Hop GUI with configuration options all over the place, Apache Hop 2.2.0 introduces a new configuration perpsective (https://issues.apache.org/jira/browse/HOP-4213[HOP-4213^]). Plugin developers can add their configuration options to this perspective image:/img/Release-2.2/hop-gui-config-perspective.png[Hop GUI - configuration perspective, width=75%] === Hop Web Hop Web has been available since the very early Apache Hop releases, but has come a long way since then. Hop Web now is a stable and usable alternative to Hop GUI on the desktop. Hop Web in Apache Hop 2.2.0 comes with numerous improvements: the number of full or partial ui refreshes has decreased significantly, only SVG images are used now, the file menu has been replaced with a more web-native hamburger menu (behind the Apache Hop logo) and many other tweaks and fixes. Check the https://hop.apache.org/manual/latest/hop-gui/hop-web.html#top["Getting Hop Web"] docs to take Hop Web for a spin. == Various component upgrades Every Hop release comes with lots of component upgrades, Apache Hop 2.2.0 is no exception. In addition to lots of smaller updates, Hop 2.2.0 contains upgrades for * https://beam.apache.org[Apache Beam^] 2.43 is the latest Apache Beam release, with support for Apache Spark 3.3.0, Apache Flink 1.15.2 and the latest Google Dataflow. * https://cassandra.apache.org/doc/4.0/cassandra/new/index.html[Apache Cassandra 4^] is Cassandra's latest major release. Cassandra 4 brings Java 11 support, virtual tables, audit and full query logging, messaging, streaming and transient replication. * https://neo4j.com/blog/announcing-neo4j-5-graph-database/[Neo4j 5^] comes with increased performance, sharding, autonomous clustering and agile operations. == Apache Beam and Google Dataflow After lengthy discussions on e.g. the Apache Hop https://lists.apache.org/thread/wv4h8zyprp0z0c010g302s8n7hcsm2kn[mailing lists^], the Google Dataflow run configuration now supports passing specific options to Google Dataflow jobs. Apache Hop pipelines can be scheduled and triggered in various ways. New in Apache Hop 2.2.0 is the ability to schedule with https://cloud.google.com/dataflow/docs/concepts/dataflow-templates[Dataflow templates^] through https://cloud.google.com/dataflow/docs/guides/templates/using-flex-templates[Flex templates^]. Check https://hop.apache.org/manual/next/pipeline/beam/dataflowPipeline/google-dataflow-pipeline.html[the docs^] for more detailed information on how to configure your own Dataflow templates. If you're working in a Beam pipeline, Hop GUI now lets you jump directly to the Google Dataflow console to follow up the execution for that pipeline. image:/img/Release-2.2/hop-gui-dataflow-console.png[Hop GUI - visit Dataflow console, width=75%] A number of smaller but noteworthy improvements in the Apache Beam integration: * The Apache Beam API now is a first-class citizen in Apache Hop. Even though this is not immediately visible, it means other transform plugins can now depend on it. * as the number of available Beam integration tests grows, we've updated the "supported engines" section in the transform docs for transforms that reliably pass the Apache Beam integration tests (https://issues.apache.org/jira/browse/HOP-4634[HOP-4634^]). * the Simple Mapping transforms now works in Apache Beam pipelines (https://issues.apache.org/jira/browse/HOP-4442[HOP-4442^]) == Various https://issues.apache.org/jira/browse/HOP-4556[HOP-4556^]: The execution information perspective now shows the execution lineage and Cypher tabs for Neo4j execution logging, similar to the initial Neo4j logging perspective. https://issues.apache.org/jira/browse/HOP-4285[HOP-4285^] Clean up XML serialization: the Apache Hop code base is moving towards a code base that is decoupled from the serialization format. This involves cleaning up the code base to replace dependencies on the XML format for pipelines and workflows with. https://issues.apache.org/jira/browse/HOP-4597[HOP-4597^] Language choice improvements in Chinese environment https://issues.apache.org/jira/browse/HOP-4627[HOP-4627^] Allow comma separated options in hop-conf --project-variable. image:/img/Release-2.2/hop-gui-neo4j-execution-logging.png[Hop GUI - Neo4j Execution Logging, width=75%] == Community The Hop community continues to grow! The Apache Hop PMC and community welcomed one new committer since the 2.1.0 release. The overview below shows the community growth compared to the 2.0.0 release in June: * chat: 481 registered members (up from 440) link:https://chat.project-hop.org[join] * LinkedIn: 1126 followers (up from 1026) link:https://www.linkedin.com/company/hop-project[follow] * Twitter: 819 followers (up from 780) link:https://twitter.com/ApacheHop[follow] * YouTube: 700 subscribers (up from 644) link:https://www.youtube.com/ApacheHop[subscribe] * 3Hx Meetup: 275 members (up from 259) link:https://www.meetup.com/3hx-apache-hop-incubating-hot-hop-hangouts/[join] image:/img/Release-2.2/hop-community-growth.png[Apache Hop Community Growth, width="60%"] Without community interaction and contribution, Hop is just a coding club! Please feel free to join, participate in the discussion, test, file bug tickets on the software or documentation, ... Contributing is a lot more than writing code. Check out our link:/community/contributing/[contribution guides^] and http://hop.apache.org/community/ethos/[Code of Conduct^] to find out more. == JIRA Apache Hop 2.2.0 contains work on 163 tickets: * Resolved: 158 * Closed: 5 2.2.0 is the latest release where tickets are managed in JIRA. Development has switched to https://github.com/apache/hop/issues[Github Issues^]. All development and bug fixes will continue there. Check the https://issues.apache.org/jira/browse/HOP-3962?jql=project%20%3D%20%22Apache%20Hop%22%20and%20fixVersion%20%3D%202.2.0[Hop Jira^] for a full overview of all tickets.