Package org.apache.manifoldcf.crawler.connectors.webcrawler

Class ThrottledFetcher.ExecuteMethodThread

  • All Implemented Interfaces:
    java.lang.Runnable
    Enclosing class:
    ThrottledFetcher
    protected static class ThrottledFetcher.ExecuteMethodThread
extends java.lang.Thread
    This thread does the actual socket communication with the server. It's set up so that it can be abandoned at shutdown time. The way it works is as follows: - it starts the transaction - it receives the response, and saves that for the calling class to inspect - it transfers the data part to an input stream provided to the calling class - it shuts the connection down If there is an error, the sequence is aborted, and an exception is recorded for the calling class to examine. The calling class basically accepts the sequence above. It starts the thread, and tries to get a response code. If instead an exception is seen, the exception is thrown up the stack.

    • Nested Class Summary

      • Nested classes/interfaces inherited from class java.lang.Thread

        java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

    • Constructor Summary

      Constructors 
      Constructor Description
      ExecuteMethodThread​(ThrottledFetcher.ThrottledConnection theConnection, org.apache.manifoldcf.connectorcommon.interfaces.IFetchThrottler fetchThrottler, org.apache.http.client.HttpClient httpClient, org.apache.http.HttpHost target, org.apache.http.client.methods.HttpRequestBase executeMethod, org.apache.http.client.CookieStore cookieStore)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void abort()  
      protected void checkException​(java.lang.Throwable exception)  
      void finishUp()  
      LoginCookies getCookies()  
      java.lang.String getFirstHeader​(java.lang.String headerName)  
      int getResponseCode()  
      java.util.Map<java.lang.String,​java.util.List<java.lang.String>> getResponseHeaders()  
      java.io.InputStream getSafeInputStream()  
      boolean isDeflateStream()  
      boolean isGZipStream()  
      void run()  

      • Methods inherited from class java.lang.Thread

        activeCount, checkAccess, clone, countStackFrames, currentThread, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, onSpinWait, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, suspend, toString, yield

      • Methods inherited from class java.lang.Object

        equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Field Detail

      • fetchThrottler

        protected final org.apache.manifoldcf.connectorcommon.interfaces.IFetchThrottler fetchThrottler
        The fetch throttler

      • httpClient

        protected final org.apache.http.client.HttpClient httpClient
        Client and method, all preconfigured

      • target

        protected final org.apache.http.HttpHost target

      • executeMethod

        protected final org.apache.http.client.methods.HttpRequestBase executeMethod

      • cookieStore

        protected final org.apache.http.client.CookieStore cookieStore

      • response

        protected org.apache.http.HttpResponse response

      • responseException

        protected java.lang.Throwable responseException

      • cookieException

        protected java.lang.Throwable cookieException

      • threadStream

        protected org.apache.manifoldcf.connectorcommon.common.XThreadInputStream threadStream

      • bodyStream

        protected java.io.InputStream bodyStream

      • streamCreated

        protected boolean streamCreated

      • streamException

        protected java.lang.Throwable streamException

      • abortThread

        protected boolean abortThread

      • gzip

        protected boolean gzip

      • deflate

        protected boolean deflate

      • shutdownException

        protected java.lang.Throwable shutdownException

      • generalException

        protected java.lang.Throwable generalException

    • Constructor Detail

      • ExecuteMethodThread

        public ExecuteMethodThread​(ThrottledFetcher.ThrottledConnection theConnection,
                           org.apache.manifoldcf.connectorcommon.interfaces.IFetchThrottler fetchThrottler,
                           org.apache.http.client.HttpClient httpClient,
                           org.apache.http.HttpHost target,
                           org.apache.http.client.methods.HttpRequestBase executeMethod,
                           org.apache.http.client.CookieStore cookieStore)

    • Method Detail

      • run

        public void run()
        Specified by:
        run in interface java.lang.Runnable
        Overrides:
        run in class java.lang.Thread

      • getResponseCode

        public int getResponseCode()
                    throws java.lang.InterruptedException,
                           java.io.IOException,
                           org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • getResponseHeaders

        public java.util.Map<java.lang.String,​java.util.List<java.lang.String>> getResponseHeaders()
                                                                                          throws java.lang.InterruptedException,
                                                                                                 java.io.IOException,
                                                                                                 org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • getFirstHeader

        public java.lang.String getFirstHeader​(java.lang.String headerName)
                                throws java.lang.InterruptedException,
                                       java.io.IOException,
                                       org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • getCookies

        public LoginCookies getCookies()
                        throws java.lang.InterruptedException,
                               java.io.IOException,
                               org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • isGZipStream

        public boolean isGZipStream()
                     throws java.lang.InterruptedException,
                            java.io.IOException,
                            org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • isDeflateStream

        public boolean isDeflateStream()
                        throws java.lang.InterruptedException,
                               java.io.IOException,
                               org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • getSafeInputStream

        public java.io.InputStream getSafeInputStream()
                                       throws java.lang.InterruptedException,
                                              java.io.IOException,
                                              org.apache.http.HttpException
        Throws:
        java.lang.InterruptedException
        java.io.IOException
        org.apache.http.HttpException

      • abort

        public void abort()

      • finishUp

        public void finishUp()
              throws java.lang.InterruptedException
        Throws:
        java.lang.InterruptedException

      • checkException

        protected void checkException​(java.lang.Throwable exception)
                       throws java.io.IOException,
                              org.apache.http.HttpException
        Throws:
        java.io.IOException
        org.apache.http.HttpException