org.forgerock / org.forgerock.opendj

05 Jun, 2013

3 commits

21 May, 2013

2 commits

  • c221f025   Fix OPENDJ-922: Replication window size is too small on high latency networks ... Browse Dir » 
    * set the default window size to 100K
* indicate that the properties may be deprecated in future releases
* tag properties as advanced.

Reviewed manually by Ludo.


git-svn-id: https://svn.forgerock.org/opendj/trunk@8888 41b1ffd8-f28e-4786-ab96-9950f0a78031
    matthew
     
  • 837c0e6a   OPENDJ-902 (CR-1702) Add connectionID to the HTTP access log + move to extended log format ... Browse Dir » 
    OPENDJ-858 (CR-1702) Add stats tracking to HTTP client connections



In HTTP access log, changed the name of the non standard "datetime" field to "x-datetime".
Added the "x-etime" field that outputs as a number.
Added validation for the log format that outputs error messages.


FileBasedHTTPAccessLogPublisherConfiguration.xml, FileBasedHTTPAccessLogPublisherConfiguration.properties:
Renamed the "datetime" field to "x-datetime" + added the "x-etime" field.
Improved the description of the ds-cfg-log-format.

TextHTTPAccessLogPublisher.java, config.properties:
Extracted constants for all supported field names.
Added ALL_SUPPORTED_FIELDS constant.
Changed logFormatFields instance member from String[] to List<String>.
Added validateLogFormat() which can output new error messages and called it from applyConfigurationChange() and initializeLogPublisher().
Added subtract().

HTTPClientConnection.java, HTTPRequestInfo.java:
Added instance member totalProcessingTime.
In sendResponse(), added to the totalProcessingTime + extracted method getProcessingTime().
Added getTotalProcessingTime().

git-svn-id: https://svn.forgerock.org/opendj/trunk@8885 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

14 May, 2013

1 commit

  • 96bbb6e9   OPENDJ-808 (CR-1685) Implement a simple commons REST based HTTP connection handler ... Browse Dir » 
    

Added support for ds-cfg-num-request-handlers in the HTTPConnectionHandler configuration to bring it at par with the LDAPConnectionHandler configuration.



02-config.ldif, HTTPConnectionHandlerConfiguration.xml, HTTPConnectionHandlerCfgDefn.properties:
Added ds-cfg-num-request-handlers.

HTTPConnectionHandler.java:
Set the SelectorRunnersCount in grizzly based on the numRequestHandlers property.

LDAPConnectionHandler.java, ConnectionHandler.java:
Moved getNumRequestHandlers() from LDAPConnectionHandler to ConnectionHandler.

git-svn-id: https://svn.forgerock.org/opendj/trunk@8868 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

13 May, 2013

2 commits

  • a191cd8c   OPENDJ-858 (CR-1651) Add stats tracking to HTTP client connections ... Browse Dir » 
    Added support for monitoring statistics of the HTTP connection handler:
It monitors: total number of requests, and number of delete, get, patch, post and put requests.
It also monitors the internal LDAP operations to display how the server is performing.


HTTPConnectionHandler.java, HTTPClientConnection.java, CollectClientConnectionsFilter.java, SdkConnectionAdapter.java:
Added support for statistics.

config.ldif, HTTPConnectionHandlerConfiguration.xml, HTTPConnectionHandlerCfgDefn.properties:
Added "keep-stats" property.

02-config.ldif:
Added attributes "ds-mon-http-*" for monitoring HTTP statistics.

LDAPStatistics.java:
Changed getMonitorData() return type to List.
Made createAttribute protected.

HTTPStatsProbe.java, HTTPStatistics.java: ADDED


git-svn-id: https://svn.forgerock.org/opendj/trunk@8859 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     
  • a1ef7230   OPENDJ-902 (CR-1654) Add connectionID to the HTTP access log + move to extended log format ... Browse Dir » 
    HTTPConnectionHandler.java, HTTPClientConnection.java, CollectClientConnectionsFilter.java, SdkConnectionAdapter.java:
Added support for statistics.

02-config.ldif, config.ldif, HTTPConnectionHandlerConfiguration.xml, HTTPConnectionHandlerCfgDefn.properties:
Added "keep-stats" property.

02-config.ldif:
Added attributes "ds-mon-http-*" for monitoring HTTP statistics.

LDAPStatistics.java:
Changed getMonitorData() return type to List.
Made createAttribute protected.

HTTPStatsProbe.java, HTTPStatistics.java: ADDED

git-svn-id: https://svn.forgerock.org/opendj/trunk@8857 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

03 May, 2013

1 commit

  • 90314ebf   OPENDJ-879 (CR-1642) Add HTTP access log ... Browse Dir » 
    

Implemented the HTTP access logger by taking inspiration from other loggers.
Configured the new logger everywhere other loggers are configured.
Logged the HTTP request in several places to cover all cases (happy paths, errors, etc.).



config.ldif, 02-config.ldif, HTTPAccessLogPublisherConfiguration.xml, FileBasedHTTPAccessLogPublisherConfiguration.xml, HTTPAccessLogPublisherCfgDefn.properties, FileBasedHTTPAccessLogPublisherCfgDefn.properties: ADDED
Added 2 new objectClasses HTTPAccessLogPublisherConfiguration and FileBasedHTTPAccessLogPublisherConfiguration.

config.properties:
Added new error messages for the HTTP access logger.

HTTPAccessLogger.java, HTTPAccessLogPublisher.java, TextHTTPAccessLogPublisher.java, HTTPRequestInfo.java: ADDED
HTTPRequestInfo.log() prevents double logging.

CollectClientConnectionsFilter.java:
Logged the request info when HttpServletResponse.setStatus(), sendAuthenticationFailure() and onFailure() are called.
Pushed more data to the HTTPRequestContext + switched to use the more specific HttpServletRequest/HttpServletResponse

SdkConnectionAdapter.java:
Logged the request info when close() is called.

LoggerConfigManager.java, TestCaseUtils.java:
Configured the HTTP access logger.

InProcessServerController.java: TO BE REMOVED (by Matt on the native packaging branch)



Sample log:
localhost bjensen [03/May/2013:10:14:54 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 500 "curl/7.27.0"
localhost bjensen [03/May/2013:10:15:05 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 200 "curl/7.27.0"
localhost  [03/May/2013:10:15:14 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 200 "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:20.0) Gecko/20100101 Firefox/20.0"
localhost  [03/May/2013:10:16:40 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 401 "curl/7.27.0"
localhost  [03/May/2013:10:16:50 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 200 "curl/7.27.0"
localhost  [03/May/2013:10:16:51 +0200] "GET /favicon.ico/null HTTP/1.1" 404 "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:20.0) Gecko/20100101 Firefox/20.0"
localhost  [03/May/2013:10:17:10 +0200] "GET /users/_queryFilter=true&_prettyPrint=true HTTP/1.1" 200 "curl/7.27.0"

git-svn-id: https://svn.forgerock.org/opendj/trunk@8832 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

25 Apr, 2013

1 commit

  • a1b5e7bf   OPENDJ-879 (CR-1603) Add HTTP access log ... Browse Dir » 
    
Consolidated common code for the *Logger classes prior to implementing the HTTP access log.


AbstractLogger.java: ADDED
Pulled up from the *Logger classes.

AccessLogger.java, ErrorLogger.java, DebugLogger.java:
Now inherit from AbstractLogger.
Removed code pulled up into AbstractLogger: initializeErrorLogger(), isConfigurationAddAcceptable(), applyConfigurationAdd(), applyConfigurationChange(), isConfigurationDeleteAcceptable(), applyConfigurationDelete(), isJavaClassAcceptable(), getErrorPublisher().
Added the loggerStorage static variable.
Added a ctor + implemented getJavaClassPropertyDefinition() and getStorage().

LoggerConfigManager.java:
Replaced the calls to the various initialize*Logger() methods with calling initializeLogger().
Extracted method getLoggerInstance() and used it in all the other methods.


LogPublisherConfiguration.xml:
Pulled up the declaration of "java-class" property here from sub configurations.

AccessLogPublisherConfiguration.xml, DebugLogPublisherConfiguration.xml, ErrorLogPublisherConfiguration.xml, LogPublisherConfiguration.xml:
Replaced the declaration of "java-class" property by a property-override.

StaticUtils.java:
Added close(Collection<Closeable>)

git-svn-id: https://svn.forgerock.org/opendj/trunk@8802 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

22 Apr, 2013

1 commit

  • b3107a80   OPENDJ-832 Leverage the work queue for processing requests received on the HTTP connection handler ... Browse Dir » 
    

Limited the number of concurrent operations per client connection.



SdkConnectionAdapter.java:
Changed the queueing strategy to BoundedWorkQueueStrategy.

BoundedWorkQueueStrategy.java: ADDED

AbandonOperationWrapper.java, xtendedOperationWrapper.java, UnbindOperationWrapper.java: ADDED

DirectoryServer.java:
Extracted checkCanEnqueueRequest() from enqueueRequest().
Added tryEnqueueRequest().

WorkQueue.java:
Pulled computeNumWorkerThreads() here from sub classes.
Added abstract method trySubmitOperation().
Added abstract getter getNumWorkerThreads().

ParallelWorkQueue.java:
Implemented trySubmitOperation() and getter getNumWorkerThreads().
Renamed getNumWorkerThreads() to computeNumWorkerThreads() + moved it to WorkQueue.

TraditionalWorkQueue.java:
Implemented trySubmitOperation() and getter getNumWorkerThreads().
Renamed getNumWorkerThreads() to computeNumWorkerThreads() + moved it to WorkQueue.
Extacted overloaded method submitOperation(Operation, boolean) from submitOperation(Operation).



ClientConnection.java, JmxClientConnection.java, HTTPClientConnection.java, InternalClientConnection.java, MockClientConnection.java, LDAPClientConnection.java:
Added abstract method isConnectionValid() + implemented it in subclasses.



02-config.ldif, HTTPConnectionHandlerConfiguration.xml:
Added property max-concurrent-ops-per-connection


git-svn-id: https://svn.forgerock.org/opendj/trunk@8775 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

12 Apr, 2013

1 commit

  • 5b0bc986   OPENDJ-830 (CR-1538) Implement authentication and authorization for HTTP connection handler ... Browse Dir » 
    Added the possibility for the HTTP Connection Handler to accept unauthenticated requests.

CollectClientConnectionsFilter.java:
Extracted method getAuthenticationInfo() and added support for unauthenticated requests here.

CollectClientConnectionsFilterTest.java:
Added tests.

HTTPConnectionHandler.java:
Added acceptUnauthenticatedRequests().

config.ldif, 02-config.ldif, HTTPConnectionHandlerConfiguration.xml, HTTPConnectionHandlerCfgDefn.properties:
Added property 'ds-cfg-authentication-required' with default 'true' to HTTP Connection Handler

git-svn-id: https://svn.forgerock.org/opendj/trunk@8733 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

08 Apr, 2013

1 commit

  • 4704c04d   Partial fix OPENDJ-662 - Upgrade JE to latest version of JE5, and modify default… ... Browse Dir » 
    … config settings to latest recommendations / expected machine capabilities.

* db-evictor-lru-only - change to false (depth based then lru) since it exhibits better behavior in partially cached deployments and does not impact cases where the DB is fully cached
* db-log-file-max - increase back to 100MB due to recent improvements in JE which mean that smaller file sizes are no longer needed. Bigger log files means less of them, less frequent fsyncs, and less FDs
* db-checkpointer-bytes-interval - increased to 500MB. The increased recovery time is minimal and a bigger checkpoint interval dramatically reduces the risk of persisting volatile data to disk
* disk-low-threshold - updated to 200MB to align with increased log file size
* disk-full-threshold - updated to 100MB to align with increased log file size

git-svn-id: https://svn.forgerock.org/opendj/trunk@8703 41b1ffd8-f28e-4786-ab96-9950f0a78031
    matthew
     

26 Mar, 2013

1 commit

25 Mar, 2013

1 commit

  • 283f541d   OPENDJ-808 Implement a simple commons REST based HTTP connection handler ... Browse Dir » 
    Added support for using the Rest2LDAP servlet from OpenDJ HTTPConnectionHandler.



HTTPConnectionHandler.java:
Added support for using the Rest2LDAP servlet + removed the FakeServlet.
Added the JSON_MAPPER constant to parse the JSON config file for Rest2LDAP.
Added getClientConnectionsMap() getter.
Added getConnectionFactory() method, heavily inspired from org.forgerock.opendj.rest2ldap.servlet.Rest2LDAPConnectionFactoryProvider.getConnectionFactory().
In startHttpServer(), silenced Grizzly logging + set the IOThreadStrategy to be single threaded + changed the access path to the servlet.

CollectClientConnectionsFilter.java:
Added support for using the Rest2LDAP servlet.
Removed clientConnections instance member, now get this value from the HTTPConnectionHandler.

config.ldif, 02-config.ldif, HTTPConnectionHandlerConfiguration.xml, HTTPConnectionHandlerCfgDefn.properties:
Added ds-cfg-config-file property to ds-cfg-http-connection-handler objectClass.

http-config.json: ADDED (copied from opendj-rest2ldap-servlet project)


ivy.xml:
Added dependencies to Rest2LDAP.

ivysettings.xml:
Added support for updating SNAPSHOTS.


git-svn-id: https://svn.forgerock.org/opendj/trunk@8638 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

20 Mar, 2013

1 commit

  • f0693aec   OPENDJ-808 Implement a simple commons REST based HTTP connection handler ... Browse Dir » 
    Added the HTTPConnnectionHandler implemented using Grizzly.
Added support for all configuration similar to the LDAPConnectionHandler.
Missing support for ds-cfg-keep-stats and ds-cfg-num-request-handlers.


config.ldif, 02-config.ldif:
Added new entry for HTTP connection handler + defaults.

HTTPConnectionHandlerCfgDefn.properties, HTTPConnectionHandlerConfiguration.xml: ADDED

LDAPConnectionHandlerConfiguration.xml:
Moved properties common to HTTPConnectionHandlerConfiguration.xml to Package.xml .

protocol*.properties:
Merged protocol messages between LDAP, HTTP and JMX. Made them non LDAP specific.
Added 2 new protocol messages for HTTP.


CollectClientConnectionsFilter.java, HTTPClientConnection.java, HTTPConnectionHandler.java, package-info.java: ADDED

JmxClientConnection.java, JmxConnectionHandler.java, LDAPClientConnection.java:
Used common protocol messages.

LDAPConnectionHandler.java
Used common protocol messages.
Extracted method configureSSL()
Simplified the code in getEnabledSSLCipherSuites() and getEnabledSSLProtocols() and protected against a multi threaded change ofg the SSL engine by using a local copy.



git-svn-id: https://svn.forgerock.org/opendj/trunk@8613 41b1ffd8-f28e-4786-ab96-9950f0a78031
    JnRouvignac
     

14 Mar, 2013

1 commit

20 Feb, 2013

1 commit

21 Dec, 2012

2 commits

19 Dec, 2012

1 commit

18 Dec, 2012

1 commit

12 Dec, 2012

1 commit

16 Nov, 2012

1 commit

  • 94a9e5d3   Typo ... Browse Dir » 
    git-svn-id: https://svn.forgerock.org/opendj/trunk@8328 41b1ffd8-f28e-4786-ab96-9950f0a78031
    mark
     

08 Nov, 2012

1 commit

10 Aug, 2012

1 commit

07 Aug, 2012

1 commit

13 Jun, 2012

1 commit

  • 95f0dca8   Fix OPENDJ-520: Worker threads are too greedy when caching memory used for encod… ... Browse Dir » 
    …ing/decoding entries and protocol messages

* introduce global option max-internal-buffer-size (default 32KB) for managing the maximum size of internal buffers
* use simpler ASN1Writer implementation for LDAP client connections
* minor fix to SASL confidentiality and integrity for large packets.


git-svn-id: https://svn.forgerock.org/opendj/trunk@8046 41b1ffd8-f28e-4786-ab96-9950f0a78031
    matthew
     

14 May, 2012

2 commits

11 May, 2012

1 commit

  • b9d7dd79   Fix OPENDJ-482: Validation for the CertificateSyntax ... Browse Dir » 
    A huge thanks to Manuel Gaupp for this contribution.

In addition to the original contributed change I have made the following alterations:

* make the CertificateSyntax strictness configurable. By default the syntax will enforce the syntax, but this can be disabled if needed

* add a new method "isHumanReadable" to AttributeSyntax and AttributeType classes in order to make it easier to determine whether or not a syntax/type is human readable. This can be used in order to determine whether or not an attribute value can be included in log messages, for example.


git-svn-id: https://svn.forgerock.org/opendj/trunk@7979 41b1ffd8-f28e-4786-ab96-9950f0a78031
    matthew
     

19 Mar, 2012

1 commit

14 Mar, 2012

1 commit

23 Feb, 2012

1 commit

02 Jan, 2012

1 commit

  • 33c1d7e7   Fix OPENDJ-391: Improve List existing Local DB Indexes output in dsconfig ... Browse Dir » 
    * don't display the "type" column when listing managed objects if there is only one type of component which can be displayed
* add "index-entry-limit" and "index-extensible-matching-rule" as default properties to be displayed when listing JE backend indexes.

git-svn-id: https://svn.forgerock.org/opendj/trunk@7584 41b1ffd8-f28e-4786-ab96-9950f0a78031
    matthew
     

12 Dec, 2011

1 commit

08 Dec, 2011

1 commit

24 Nov, 2011

1 commit

09 Nov, 2011

1 commit

03 Nov, 2011

1 commit

  • 97552f10   Typo ... Browse Dir » 
    git-svn-id: https://svn.forgerock.org/opendj/trunk@7456 41b1ffd8-f28e-4786-ab96-9950f0a78031
    mark