Executing CQL Statements
API to execute CQL statements on services accepting CQN queries.
Query Execution
CDS Query Language (CQL) statements can be executed using the run
method of any service that accepts CQN queries:
CqnService service = ...
CqnSelect query = Select.from("bookshop.Books")
.columns("title", "price");
Result result = service.run(query);
Parameterized Execution
Queries, as well as update and delete statements, can be parameterized with named, or indexed parameters. Update and delete statements with named parameters can be executed in batch mode using multiple parameter sets.
Named Parameters
The following statement uses two parameters named id1 and id2. The parameter values are given as a map:
import static com.sap.cds.ql.CQL.param;
CqnDelete delete = Delete.from("bookshop.Books")
.where(b -> b.get("ID").eq(param("id1"))
.or(b.get("ID").eq(param("id2"))));
Map<String, Object> paramValues = new HashMap<>();
paramValues.put("id1", 101);
paramValues.put("id2", 102);
Result result = service.run(delete, paramValues);
WARNING
The parameter value map must be of type Map<String, Object>
, otherwise the map is interpreted as a single positional/indexed parameter value, which results in an error.
Indexed Parameters
The following statement uses two indexed parameters defined through param(i)
:
import static com.sap.cds.ql.CQL.param;
CqnDelete delete = Delete.from("bookshop.Books")
.where(b -> b.get("ID").in(param(0), param(1)));
Result result = service.run(delete, 101, 102);
Before the execution of the statement the values 101 and 102 are bound to the defined parameters.
Batch Execution
Update and delete statements with named parameters can be executed as batch with multiple parameter sets. The named parameters example from above can be expressed using batch delete with a single parameter and two value sets:
import static com.sap.cds.ql.CQL.param;
CqnDelete delete = Delete.from("bookshop.Books").byParams("ID");
Map<String, Object> paramSet1 = singletonMap("ID", 101);
Map<String, Object> paramSet1 = singletonMap("ID", 102);
Result result = service.run(query, asList(paramSet1, paramSet2));
long deletedRows = result.rowCount();
From the result of a batch update/delete the total number of updated/deleted rows can be determined by rowCount(), and rowCount(batchIndex) returns the number of updated/deleted rows for a specific parameter set of the batch. The number of batches can be retrieved via the batchCount() method. Batch updates also return the update data.
The maximum batch size for update and delete can be configured via cds.sql.max-batch-size
and has a default of 1000.
Querying Parameterized Views on SAP HANA
To query views with parameters on SAP HANA, build a select statement and execute it with named parameter values that correspond to the view's parameters.
Let's consider the following Books
entity and a parameterized view BooksView
, which returns the ID
and title
of Books
with stock
greater or equal to the value of the parameter minStock
:
entity Books {
key ID : UUID;
title : String;
stock : Integer;
}
entity BooksView(minStock : Integer) as
SELECT from Books {ID, title} where stock >= :minStock;
To query BooksView
in Java, run a select statement and provide values for all view parameters:
CqnSelect query = Select.from("BooksView");
var params = Map.of("minStock", 100);
Result result = service.run(query, params);
Query Hints
To add a hint clause to a statement, use the hints
method and prefix the SAP HANA hints with hdb.
:
Select.from(BOOKS).hints("hdb.USE_HEX_PLAN", "hdb.ESTIMATION_SAMPLES(0)");
No external input in SQL for SAP HANA
Hints prefixed with hdb.
are directly rendered into SQL for SAP HANA and therefore must not contain external input!
Data Manipulation
The CQN API allows to manipulate data by executing insert, update, delete, or upsert statements.
Update
The update operation can be executed as follows:
Map<String, Object> book = Map.of("title", "CAP");
CqnUpdate update = Update.entity("bookshop.Books").data(book).byId(101);
Result updateResult = service.run(update);
The update Result
contains the data that is written by the statement execution. Additionally to the given data, it may contain values generated for managed data and foreign key values.
The row count of the update Result
indicates how many rows where updated during the statement execution:
CqnUpdate update = ...
long rowCount = service.run(update).rowCount();
If no rows are touched the execution is successful but the row count is 0.
Update with expressions
The setters of an update with expressions are evaluated on the database. The result of these expressions is not contained in the update result.
Structured Documents
It's possible to work with structured data as the insert, update, and delete operations cascade along compositions.
Cascading over Associations
By default, insert, update and delete operations cascade over compositions only. For associations, this can be enabled using the @cascade
annotation.
Avoid cascading over associations
Cascading operations over associations isn't considered good practice and should be avoided.
Annotating an association with @cascade: {insert, update, delete}
enables deep updates/upserts through this association. Given the following CDS model with two entities and an association between them, only insert and update operations are cascaded through author
:
entity Book {
key ID : Integer;
title : String;
@cascade: {insert, update}
author : Association to Author;
}
entity Author {
key ID : Integer;
name : String;
}
Warning
For inactive draft entities
@cascade
annotations are ignored.The
@cascade
annotation is not respected by foreign key constraints on the database. To avoid unexpected behaviour you might have to disable a foreign key constraint with@assert.integrity:false
.
Deep Insert / Upsert
Insert and upsert statements for an entity have to include the keys and (optionally) data for the entity's composition targets. The targets are inserted or upserted along with the root entity.
Iterable<Map<String, Object>> books;
CqnInsert insert = Insert.into("bookshop.Books").entries(books);
Result result = service.run(insert);
CqnUpsert upsert = Upsert.into("bookshop.Books").entries(books);
Result result = service.run(upsert);
Cascading Delete
The delete operation is cascaded along the entity's compositions. All composition targets that are reachable from the (to be deleted) entity are deleted as well.
The following example deletes the order with ID 1000 including all its items:
CqnDelete delete = Delete.from("bookshop.Orders").matching(singletonMap("OrderNo", 1000));
long deleteCount = service.run(delete).rowCount();
Views and Projections
With CDS views you can derive new entities from existing ones, for example to rename or exclude certain elements, or to add virtual elements for specific use cases.
From the CDS model the CDS compiler generates DDL files, which include SQL views for the CDS views. These views are deployed to the database and used by the CAP runtime to read data.
For read-only views, you can use the full feature set of selects, including aggregations to summarize, as well as joins and unions to combine data from multiple entities. However, such complex views are not writable and require a schema redeployment if the view definition is changed.
Annotate read-only views and elements
Use the @readonly
annotation to indicate that a view or a view element is not writable, as this is not automatically detected by the CDS compiler.
To write data or delete through views, only use simple projections. The CAP Java runtime attempts to resolve the CDS views to their underlying persistence entities, rewriting the statement and data accordingly, which is not supported for complex views.
For simple projections, the generation of SQL views can be avoided by using runtime views. This allows you to change the view definition without redeploying the database schema and is the prerequisite for lightweight extensibility via predefined extension fields.
Prefer simple views
Apply the Interface Segregation Principle: design multiple simple views, each for a specific use case (Single-Purposed Services), rather than one complex view for many scenarios.
Avoid selecting paths over to-many Associations
Do not use path expressions over to-many associations in the select clause of CDS views. This blocks write operations and may cause performance issues due to record duplication on read.
Avoid composition definitions in views
Avoid defining new compositions in CDS views and prefer associations instead, as deep write and cascading delete are only supported for compositions in persistence entities.
Write through Views
You can run insert, upsert, and update statements on CDS views that are writable on the database or can be resolved to a single persistence entity by the CAP Java runtime.
CDS views must fulfill the following requirements to be resolvable:
- The view is a simple projection, not using aggregations, join, union, or where.
- The projection includes all not null elements (incl. keys), unless they have a default or generated value.
- The projection does not include path expressions using to-many associations.
If the runtime cannot resolve a view, the write operation is executed directly on the database view and the execution depends on the database support.
For example, the following CDS model defines two resolvable views on the Order
entity, which has a to-many items and a to-one header composition to a Header entity with a to-one customer association. In the projection, you can use path expressions as shown by headerStatus (writable) and customerName (read-only):
// CDS views supporting write operations
entity OrderView1 as projection on Order excluding { createdBy };
entity OrderView2 as projection on OrderView1 {
key ID,
header.status as headerStatus, // writable composition path
header.customer.name as customerName @readonly,
items as lineItems, // writable composition
toUpper(shipToCountry) as country : String // ignored on write
};
UPDATE entity OrderView2
{ ID: 42, headerStatus: 'Processing', lineItems: [{ID: 1, book:251}] }
Data for elements corresponding to expressions and functions (country) is ignored.
Deep write via (aliased) compositions (lineItems) is supported if there are corresponding compositions (items) in the underlying entity definition. Deep write via compositions that are only defined in the view (for example via mixins) is not supported and the data is ignored.
Path expressions over compositions of one (header.status) are writable. For inserts, the view must expose all not null elements of the target entity and the data must include values for all of them. In the example above, the order header must have a generated key to support inserting new orders with a value for headerStatus.
Path Expressions over Associations
Path expressions navigating associations (header.customer.name) are not writable by default. To avoid issues on write, annotate them with @readonly.
Delete through Views
The CAP Java runtime attempts to resolve deletes on CDS views to the underlying persistence entity definitions and the write through views restrictions apply accordingly.
If a view cannot be resolved, the delete operation is executed directly on the database view and the execution depends on the database support.
Delete cascades on persistence entity level
Cascading delete is applied on persistence entity level only, including compositions that are excluded from the view. Compositions that are added in CDS views, as well as changes to compositions (such as filters and redirects) are not considered.
For example, the following CDS model defines Order
with header and items, and OrderView
which excludes header and exposes items as lineItems
:
entity Order : cuid, managed {
header : Composition of one OrderHeader;
items : Composition of many OrderItem on items.parent = $self;
}
entity OrderView as projection on db.Order {
ID,
items as lineItems,
delivery : Composition of one Delivery on delivery.order = $self
}
DELETE from OrderView where ID = 42
The delete operation is resolved to the underlying Order
entity with ID 42 and cascades over the header
and items
compositions. The delivery
composition, which is only defined in the view, is ignored and does not cascade the delete operation to Delivery
.
Runtime Views
To add or update CDS views without redeploying the database schema, annotate them with @cds.persistence.skip. This advises the CDS compiler to skip generating database views for these CDS views. Instead, CAP Java resolves them at runtime on each request.
Runtime views must be simple projections, not using aggregations, join, union or subqueries in the from clause, but may have a where condition if they are only used to read. On write, the restrictions for write through views apply in the same way as for standard CDS views. However, if a runtime view cannot be resolved, a fallback to database views is not possible, and the statement fails with an error.
CAP Java provides two modes for resolving runtime views during read operations: cte and resolve.
Changing the runtime view mode
To globally set the runtime view mode, use the property cds.sql.runtimeView.mode
with value cte
(the default) or resolve
in the application.yml. To set the mode for a specific runtime view, annotate it with @cds.java.runtimeView.mode: cte|resolve
.
To set the mode for a specific query, use a hint:
Select.from(BooksWithLowStock).hint("cds.sql.runtimeView.mode", "resolve");
The next two sections introduce both modes using the following CDS model and query:
entity Books {
key ID : UUID;
title : String;
stock : Integer;
author : Association to one Authors;
}
@cds.persistence.skip
entity BooksWithLowStock as projection on Books {
ID, title, author.name as author
} where stock < 10; // makes the view read only
SELECT from BooksWithLowStock where author = 'Kafka'
Read in cte
mode
This is the default mode since CAP Java 4.x
. The runtime translates the view definition into a Common Table Expression (CTE) and sends it with the query to the database.
WITH BOOKSWITHLOWSTOCK_CTE AS (
SELECT B.ID,
B.TITLE,
A.NAME AS "AUTHOR"
FROM BOOKS B
LEFT OUTER JOIN AUTHOR A ON B.AUTHOR_ID = A.ID
WHERE B.STOCK < 10
)
SELECT ID, TITLE, AUTHOR AS "author"
FROM BOOKSWITHLOWSTOCK_CTE
WHERE A.NAME = ?
CAP Java 3.10
Enable cte mode with cds.sql.runtimeView.mode: cte
Read in resolve
mode
The runtime resolves the view definition to the underlying persistence entities and executes the query directly against the corresponding tables.
SELECT B.ID, B.TITLE, A.NAME AS "author"
FROM BOOKS AS B
LEFT OUTER JOIN AUTHORS AS A ON B.AUTHOR_ID = A.ID
WHERE B.STOCK < 10 AND A.NAME = ?
Limitations of resolve
mode
Using associations that are only defined in the view, as well as complex draft queries are not supported in resolve mode.
Pessimistic locking on PostgreSQL
On PostgreSQL, some pessimistic locking queries on runtime views navigating associations require the cte mode.
Draft Queries on Views
When draft-enabling a CDS view, the CDS Compiler creates a corresponding draft persistence table for this view. Draft activate updates the active entity via the view.
That means:
-> Draft-enabled CDS views must fulfill all requirements of updatable views.
Remember to run draft specific queries through the Draft Service or Application Service. The Persistence Service only works for non-draft specific queries.
Draft queries on runtime views
If you define runtime views on draft-enabled entities and want to run draft specific queries on these views, set the cds.drafts.persistence configuration to split
.
Avoid draft-enabling runtime views
Draft-enabling runtime views is only supported in CTE mode and requires a schema deployment to update the draft table when the runtime view is changed.
Views on Remote Services
When delegating queries between Application Services and Remote Services, statements are resolved to the targeted service's entity definition by the CAP Java runtime.
For read, the CDS views are resolved similar to the runtime view resolve mode. For write operations, views targeting remote OData services must fulfill the following:
- all requirements of writable views
- not include calculated elements
If a view cannot be resolved, read and write operations are rejected.
Concurrency Control
Concurrency control allows protecting your data against unexpected concurrent changes.
Optimistic Locking
Use optimistic concurrency control to detect concurrent modification of data across requests. The implementation relies on an ETag, which changes whenever an entity instance is updated. Typically, the ETag value is stored in an element of the entity.
Optimistic Concurrency Control in OData
In the OData protocol, the implementation relies on ETag
and If-Match
headers in the HTTP request.
The @odata.etag
annotation indicates to the OData protocol adapter that the value of an annotated element should be used as the ETag for conflict detection:
entity Order : cuid {
@odata.etag
@cds.on.update : $now
@cds.on.insert : $now
modifiedAt : Timestamp;
product : Association to Product;
}
The ETag Predicate
An ETag can also be used programmatically in custom code. Use the CqnEtagPredicate
to specify the expected ETag values in an update or delete operation. ETag checks are not executed on upsert. You can create an ETag predicate using the CQL.eTag
or the StructuredType.eTag
methods.
PersistenceService db = ...
Instant expectedLastModification = ...;
CqnUpdate update = Update.entity(ORDER).entry(newData)
.where(o -> o.id().eq(85).and(
o.eTag(expectedLastModification)));
Result rs = db.execute(update);
if (rs.rowCount() == 0) {
// order 85 does not exist or was modified concurrently
}
In the previous example, an Order
is updated. The update is protected with a specified ETag value (the expected last modification timestamp). The update is executed only if the expectation is met.
Application has to check the result
No exception is thrown if an ETag validation does not match. Instead, the execution of the update (or delete) succeeds but doesn't apply any changes. Ensure that the application checks the rowCount
of the Result
and implement your error handling. If the value of rowCount
is 0, that indicates that no row was updated (or deleted).
Providing new ETag Values with Update Data
A convenient option to determine a new ETag value upon update is the @cds.on.update annotation as in the example above. The CAP Java runtime automatically handles the @cds.on.update
annotation and sets a new value in the data before the update is executed. Such managed data can be used with ETags of type Timestamp
or UUID
only.
We do not recommend providing a new ETag value by custom code in a @Before
-update handler. If you do set a value explicitly in custom code and an ETag element is annotated with @cds.on.update
, the runtime does not generate a new value upon update for this element. Instead, the value that comes from your custom code is used.
Runtime-Managed Versions beta
Alternatively, you can store ETag values in version elements. For version elements, the values are exclusively managed by the runtime without the option to set them in custom code. Annotate an element with @cds.java.version
to advise the runtime to manage its value.
entity Order : cuid {
@odata.etag
@cds.java.version
version : Int32;
product : Association to Product;
}
Compared to @cds.on.update
, which allows for ETag elements with type Timestamp
or UUID
only, @cds.java.version
additionally supports all integral types Uint8
, ... Int64
. For timestamp, the value is set to $now
upon update, for elements of type UUID a new UUID is generated, and for elements of integral type the value is incremented.
Version elements can be used with an ETag predicate to programmatically check an expected ETag value. Moreover, if additionally annotated with @odata.etag
, they can be used for conflict detection in OData.
Expected Version from Data
If the update data contains a value for a version element, this value is used as the expected value for the version. This allows using version elements in a programmatic flow conveniently:
PersistenceService db = ...
CqnSelect select = Select.from(ORDER).byId(85);
Order order = db.run(select).single(Order.class);
order.setAmount(5000);
CqnUpdate update = Update.entity(ORDER).entry(order);
Result rs = db.execute(update);
if (rs.rowCount() == 0) {
// order 85 does not exist or was modified concurrently
}
During the execution of the update statement it's asserted that the version
has the same value as the version
, which was read previously and hence no concurrent modification occurred.
The same convenience can be used in bulk operations. Here the individual update counts need to be introspected.
CqnSelect select = Select.from(ORDER).where(o -> amount().gt(1000));
List<Order> orders = db.run(select).listOf(Order.class);
orders.forEach(o -> o.setStatus("cancelled"));
Result rs = db.execute(Update.entity(ORDER).entries(orders));
for(int i = 0; i < orders.size(); i++) if (rs.rowCount(i) == 0) {
// order does not exist or was modified concurrently
}
If an ETag predicate is explicitly specified, it overrules a version value given in the data.
Pessimistic Locking
Use database locks to ensure that data returned by a query isn't modified in a concurrent transaction. Exclusive locks block concurrent modification and the creation of any other lock. Shared locks, however, only block concurrent modifications and exclusive locks but allow the concurrent creation of other shared locks.
To lock data:
- Start a transaction (either manually or let the framework take care of it).
- Query the data and set a lock on it.
- Perform the processing and, if an exclusive lock is used, modify the data inside the same transaction.
- Commit (or roll back) the transaction, which releases the lock.
To be able to query and lock the data until the transaction is completed, just call a lock()
method and set an optional parameter timeout
.
In the following example, a book with ID
1 is selected and locked until the transaction is finished. Thus, one can avoid situations when other threads or clients are trying to modify the same data in the meantime:
// Start transaction
// Obtain and set a write lock on the book with id 1
service.run(Select.from("bookshop.Books").byId(1).lock());
...
// Update the book locked earlier
Map<String, Object> data = Collections.singletonMap("title", "new title");
service.run(Update.entity("bookshop.Books").data(data).byId(1));
// Finish transaction
The lock()
method has an optional parameter timeout
that indicates the maximum number of seconds to wait for the lock acquisition. If a lock can't be obtained within the timeout
, a CdsLockTimeoutException
is thrown. If timeout
isn't specified, a database-specific default timeout will be used.
The parameter mode
allows to specify whether an EXCLUSIVE
or a SHARED
lock should be set.
Using I/O Streams in Queries
As described in section Predefined Types it's possible to stream the data, if the element is annotated with @Core.MediaType
. The following example demonstrates how to allocate the stream for element coverImage
, pass it through the API to an underlying database and close the stream.
Entity Books
has an additional annotated element coverImage : LargeBinary
:
entity Books {
key ID : Integer;
title : String;
...
@Core.MediaType
coverImage : LargeBinary;
}
Java snippet for creating element coverImage
from file IMAGE.PNG
using java.io.InputStream
:
// Transaction started
Result result;
try (InputStream resource = getResource("IMAGE.PNG")) {
Map<String, Object> book = new HashMap<>();
book.put("title", "My Fancy Book");
book.put("coverImage", resource);
CqnInsert insert = Insert.into("bookshop.Books").entry(book);
result = service.run(insert);
}
// Transaction finished
Using Native SQL
CAP Java doesn't have a dedicated API to execute native SQL Statements. However, when using Spring as application framework you can leverage Spring's features to execute native SQL statements. See Execute SQL statements with Spring's JdbcTemplate for more details.
Query Result Processing
The result of a query is abstracted by the Result
interface, which is an iterable of Row
. A Row
is a Map<String, Object>
with additional convenience methods and extends CdsData.
You can iterate over a Result
:
Result result = ...
for (Row row : result) {
System.out.println(row.get("title"));
}
Or process it with the Stream API:
Result result = ...
result.forEach(r -> System.out.println(r.get("title")));
result.stream().map(r -> r.get("title")).forEach(System.out::println);
If your query is expected to return exactly one row, you can access it with the single
method:
Result result = ...
Row row = result.single();
If it returns a result, like a find by id
would, you can obtain it using first
:
Result result = ...
Optional<Row> row = result.first();
row.ifPresent(r -> System.out.println(r.get("title")));
The Row
's getPath
method supports paths to simplify extracting values from nested maps. This also simplifies extracting values from results with to-one expands using the generic accessor. Paths with collection-valued segments and infix filters are not supported.
CqnSelect select = Select.from(BOOKS).columns(
b -> b.title(), b -> b.author().expand()).byId(101);
Row book = dataStore.execute(select).single();
String author = book.getPath("author.name");
Null Values
A result row may contain null
values for an element of the result if no data is present for the element in the underlying data store.
Use the get
methods to check if an element is present in the result row:
if (row.get("name") == null) {
// handle mising value for name
}
Avoid using containsKey
to check for the presence of an element in the result row. Also, when iterating the elements of the row, keep in mind, that the data may contain null
values:
row.forEach((k, v) -> {
if (v == null) {
// handle mising value for element v
}
});
Typed Result Processing
The element names and their types are checked only at runtime. Alternatively you can use interfaces to get typed access to the result data:
interface Book {
String getTitle();
Integer getStock();
}
Row row = ...
Book book = row.as(Book.class);
String title = book.getTitle();
Integer stock = book.getStock();
Interfaces can also be used to get a typed list or stream over the result:
Result result = ...
List<Book> books = result.listOf(Book.class);
Map<String, String> titleToDescription =
result.streamOf(Book.class).collect(Collectors.toMap(Book::getTitle, Book::getDescription));
For the entities defined in the data model, CAP Java SDK can generate interfaces for you through a Maven plugin.
Entity References
For result rows that contain all key values of an entity, you get an entity reference via the ref()
method. This reference addresses the entity via the key values from the result row.
// SELECT from Author[101]
CqnSelect query = Select.from(AUTHOR).byId(101);
Author authorData = service.run(query).single(Author.class);
String authorName = authorData.getName(); // data access
Author_ author = authorData.ref(); // typed reference to Author[101]
Similar for untyped results:
Row authorData = service.run(query).single();
StructuredType<?> author = authorData.ref(); // untyped reference to Author[101]
This also works for Insert
and Update
results:
CqnUpdate update = Update.entity(AUTHOR).data("name", "James Joyce").byId(101);
Author_ joyce = service.run(update).single(Author.class).ref();
Using entity references you can easily write CDS QL statements targeting the source entity:
// SELECT from Author[101].books { sum(stock) as stock }
CqnSelect q = Select.from(joyce.books())
.columns(b -> func("sum", b.stock()).as("stock"));
CqnInsert i = Insert.into(joyce.books())
.entry("title", "Ulysses");
CqnUpdate u = Update.entity(joyce.biography())
.data("price", 29.95);
CqnDelete d = Delete.from(joyce.address())
.where(b -> b.stock().lt(1));
Introspecting the Row Type
The rowType
method allows to introspect the element names and types of a query's Result
. It returns a CdsStructuredType
describing the result in terms of the Reflection API:
CqnSelect query = Select.from(AUTHOR)
.columns(a -> a.name().as("authorName"), a -> a.age());
Result result = service.run(query);
CdsStructuredType rowType = result.rowType();
rowType.elements(); // "authorName", "age"
rowType.getElement("age").getType().getQualifiedName(); // "cds.Integer"
rowType.findElement("ID"); // Optional.empty()