IBM公司ESB、WEBSPHERE、SOA技术交流.ppt

ESB设计与最佳实践,陆正武IBM Certificated SOA A,东风汽车有限公司,2,议程,ESB、SOA与WebSphere的关系什么时候需要用到ESBESB架构标准实践ESB设计原则实践IBM关于建立东风有限统一的ESB的建议方案IBM ESB的独特优势IBM ESB案例分享,ESB、SOA和WebSphere的关系,4,As Patterns Have Evolved,So Has IBM,应用之间点对点的连接实现简单、基本的信息交互和数据传递,传统架构基于消息传递的模式,通过HUB模式实现应用之间的整合很容易管理大量的连接和系统,过渡架构企业应用整合,通过企业服务总线实现服务的整合集中和流程实现 借助标准的接口灵活地连接，实现真正的随需应变,先进构架面向服务体系架构SOA,IT构架的演变 The next stage of integration,5,一种充分利用开放标准，将软件资产展现为服务的结构提供软件资产标准的展现和交互途径在开发其他应用的时候，可以将独立的软件资产封装为一个一个的“积木”更注重应用之间的装配而不是实现细节,什么是SOA？为什么采用SOA？,封装可以实现重用采用独立的实现接口描述，容易整合各种应用由于明确定义了应用系统间的接口，容易实现应用流程模型就象搭积木！,6,关键概念,SOA通过明确的定义和松散藕荷来提升系统间的弹性:Service：服务任何事情都可以是一个服务,一个实现了唯一功能的自包容的实体Service 交互外部用户调用服务服务可以彼此交互，调用操作和交换数据Service交互可以是间接的Service 编排通过调用服务,可以编排实现业务流程Service 发现一个注册的服务可以在构建时或者运行时被发现,7,Service Interaction,企业服务总线(ESB)概念经常用来表示服务互相交互的机制，它提供了通信的基础架构 企业服务总线应当提供:一致的、位置透明的、协议独立的手段来实现交互一致的、位置透明的交互意味服务消费者和提供者之间可以是间接的无论何种通信服务，应提供端到端的连通保证,8,什么是Enterprise Service Bus？,An Enterprise Service Bus is a core component of a Services Oriented Architecture 它连接和集成企业和组织的IT infrastructure,across many locations,支持不同的transport services,and它可以自动路由消息并且提供系统级的功能，如：消息的格式自动转换,and必须是基于标准的规范,and这些必须是安全的、可靠的，并且在高负荷的情况下可管理,9,ESB应该有哪些服务？,传输服务 安全、可靠的数据传输 永久性/非永久性 同步/异步仲裁服务 路由 格式转换事件服务 事件发现和发布 Publish/Subscribe,An Enterprise Service Bus(ESB)is a flexible connectivity infrastructure for integrating applications and services.,An ESB powers your SOA by reducing the number,size,and complexity of interfaces.,10,业务创新和优化,业务用面板,IT 对流程的支持,SOA 参考架构,11,IBM软件助您实现整合计算,信息,流程,人员,软件资产管理和整合开发平台,12,SOA参考框架下WebSphere产品线,IT 服务管理,业务创新和优化服务,业务应用程序服务,开发服务,合作伙伴服务,应用程序和信息资产,连接性服务,流程服务,信息服务,交互服务,Business Modeler,WebSphere,工具,Rational,BusinessMonitor,WebSphere,Tivoli,工具,Portal,WebSphere,Workplace,IBM,Information Integrator,BI Server Foundation,WebSphere,WebSphere,WebSphere,WebSphere,Application Server,Partner Gateway,MQ,WebSphere,Message Broker,WebSphere,Tivoli,Intelligent Orchestrator,Tivoli,Monitoring,Tivoli,Access Manager,Information Integrator,WebSphere,Business IntegrationAdapters,WebSphere,WebSphere,ESB,WebSphere,Process Server,Integration Developer,WebSphere,DataPower,什么时候需要用 ESB,14,什么时候需要用 ESB,ESB 网关 recommendation DataPower SOA Appliance for any external services to protect against XML threats中介 between non-standards based systems and standards based systems 支持动态更改提供者(routing,replacement,load balancing,protocol changes)Including versioning Minimize changes to requestors支持请求者与提供者之间协议和数据格式不同时的交互Adding new requestors who are not an exact match with providerCommon security,management,monitoring enforcement,15,ESB架构模式核心原则,ESB inter-connects requester and providerInteractions are decoupledSupports key SOA principle separation of concernsESB provides Service Virtualization ofIdentity via routingInteraction via conversionInterface via transformationESB also enables Aspect Oriented ConnectivitySecurity Management LoggingAuditing Described in a whitepaper by Greg Flurryhttp:/,ESB,ESB架构实践,17,1.确定参考架构,ESB涉及多平台，多项目Usually spearheaded by a corporate Architecture team or Infrastructure teamNeeds participation and agreement from Networking,Security,Application Development,and OperationsA Reference Architecture is a key document and process for securing this agreement across all stakeholders核心架构、设计和管控决策可选的技术路线和设计模式提供常见场景和使用实践,18,定义接口和连接标准,ESB功能全面，大多数企业不会使用到所有功能You need to decide what connectivity options to allow both internally and externally确定总线上实现哪些功能及gateways 和 adaptersGateways are access points for bridging on and off the busCan be used as policy enforcement pointsAdapters are mechanisms for bringing information onto or off of the bus确定采用哪种标准路线Emphasize industry standards for external(partner)communication确定所支持的常见数据表示Canonical message formats allow for shared transformation mediations,19,Expanded view of the ESB,20,以ESB为中心的逻辑模型,Outside ESBBusiness Logic(Business Services)ESB does contain integration logic or connectivity logicCriteria:semantics versus syntax;aspectsLoosely coupled to ESBSecurity and ManagementPolicy Decision Point outside the ESBESB can be Policy Enforcement Point,Tightly coupled to ESBService RegistryRegistry a Policy Decision Point for ESBESB a Policy Enforcement Point for RegistryBut,Registry has a broader scope in SOATooling required for ESBDevelopmentAdministrationConfigures ESB via Service Registry,ESB,Management Services,Security,Management,Application Services,Information,Process,Interaction,Access,Business App,Partner,Registry,Development Services,21,2.定义公共术语表,ESB没有统一的术语Vendors and clients are variable in their definition of what is part of the ESB and terminologyIBM has varying terminology in our ESB productsPatterns work has its own terminology 构建ESB/SOA时非常重要的一点就是建立统一的术语表,22,使用规范还是标准？,A specification outlines APIs/data/formats from one or more vendors working togetherProposed by vendors to address a gapOften supported by some vendors softwareUsually submitted to a standards bodyMore companies get involved,specification changes,sometimes merged with competing specificationsGoes through multiple drafts and reviewsStandard is agreed to by the standards bodys committee members and is declared a version x standardStandards bodies vary by process,rigor,respect and adoption rateAnd specific standards vary wrt to adoption,23,3.Apply criteria on whether to use a standard or specification,是否很好地描述了我们的需求?标准是否覆盖了我们的需求?是否需要在不同平台上的互操作性和可移植性?采用的到底是标准还是规范，标准和规范的成熟度如何?是否支持所有的供应商平台，版本是否具有连续性?采用的标准是否支持WS-I?我们的供应商是否也支持?是否需要采用最新版本的标准?如果供应商系统不支持现有标准，只支持早期的规范，如何移植?是否可以增加一层标准的API，以保护你的代码?采用的标准和规范是否比我们所需要的更复杂?,24,4.从企业基础架构中分离出业务逻辑,基本设计原则：需要分离考虑：Business logic does not belong in mediationsESB 架构于业务逻辑之上-the business logic may put information into headersExample:business logic determines whether a customer deserves priority treatment,sets a flag in the header,the ESB routes to highest performing provider分离业务逻辑和应用程序逻辑Use BPEL and choreography for that instead,25,5.采用基于模式的研究方法,Enterprise Integration Patterns(Hohpe)has a set of 60+patterns that cover common messaging and EI situationsIncludes an abstract notation for representing the patternsUsing this notation allows you to decide on the content and flow of the mediations without having implementation considerations drive the process帮助实现多个ESB产品之间耦合的配置方便查找应用程序之间的公共部分在大多数ESB工具中容易实现(WMB,WESB,DataPower)Use the IBM Patterns for e-Business to map out your ESB topologies,26,EIP Patterns Organization,Application,Application,Message,Channel,Routing,Translation,Endpoint,Systems Management,27,The SOA/ESB Design Pattern(P4eB),Demilitarized Zone,Web Services Gateway,Partner Zone,Enterprise Secure Zone,Enterprise Service Bus,Enterprise Service Bus Gateway,Back-end Resource Gateway,Domain Firewall,Inter-Enterprise Zone,Protocol Firewall,Network Infrastructure,28,6.确定服务提供者查找方法论 ESB 需要提供者的源头,An ESB must send the message to one or more provider endpoints在可选的提供者之间作出选择Options for managing endpoint lookupNot recommendedNo endpoint lookup(fixed addresses)Change endpoint administratively on the ESB serversProvider must keep track of all ESB servers which can call itIP spraying or load balancing between ESB and providers Limited to IP,providers maybe outside of your domainEndpoint(s)lookup from a registry使用Cache，而不是直接向注册库Providers update the registry with new endpointsSeparates ESB from the providers允许无缝增加新的providers 和ESB服务器,29,(6)Message is transformed and routed to the selected endpoint.,Message,(1)A Message is received,ESBMediation,(2)Invokes a selection mediation.,(3)Retrieve requestor information,(4)Retrieves candidate providers information,Message,(5)Executes matching algorithm to identify the provider service for requestor service,Message,Service,Dynamic selection,WSRR supportWESB 6.0.2 mediation primitivePort Type matchWMB SupportPac Port Type matchGeneral metadata retrievalDP 3.6.0.8 and higher firmware,7.使用 Service 注册表,30,8.确定Services版本方法,Option 1:利用兼容的schema设计实现Option 2:在ESB中实现多版本的.Option 3:利用ESB在不同版本之间进行转换,31,Services Versioning Approaches,32,9.设置端到端的 QOS指导方针,在SOA中，性能方面的考虑比其他非SOA的应用复杂得多Need to include mediations and transports in performance budgetsMore shared resources to consider需要了解每个service的负载及应用程序中介的负担对SOA流程端到端的监控计划采用可选的技术，如DP 和 WebSphere XD 来管理 QOS,33,10.设立公共安全策略,ESB是共享资源，安全策略更为重要This is a least-common denominator from which you can expandSecurity must be holisticEach enterprise has its own balance of risk and countermeasures but ultimately must support the business model for information protection&user access定义端到端的安全模型Document existing security practices,policies and requirements Perform a risk assessment to document vulnerabilities and countermeasures to address known risksWhat are the legal issues involved?Are there requirements where policies are(/should be)being enforced?Is a manual procedure(code review)for application development the control point?确定安全策略及策略控制点,34,11.Determine Ownership of the ESB,The question of who owns the ESB(s)often nearly stops many ESB projects 网络组?核心架构组?项目组管理 ESBs?大多数案例中，中央集权的管理是成功的 在ESB中只部分需要共享的WEB资源 If centralization is impossible,then a central team should control federation,ESB设计原则实践,36,1.确定规范或不规范消息模型,在ESB中建议采用一致规范的消息模型.If any requester or provider does not understand the canonical message(Hohpe),then the canonical message is transformed into the message format of the requester or provider.This transformation may be done by ESB or one the requester or provider.如果没有规范的消息模型，ESB就成了点对点的集成Which increases cost to add new requestors and providers.,37,When do you adopt a standard or a specification?Industry Standards and XML Schema issues,ESB 采用工业标准的规范格式 在需要集成供应商和客户的系统时更需要采用工业标准不同行业有自己的行业标准Some popular ones HL7 for healthcare,ACORD for insurance有些客户需要扩展某些标准Many industry schemas leverage XML Schema elements that are not(yet)well supported by Web service environments/toolsMost common examples are and xsd:choiceVendor support for these complex schema elements is varied in some cases proprietary or not fully supportedTry to avoid those if you canJAX-RPC has limited schema support-JAX-WS 2.0/JAXB 2.0 will support full set of schema elementsIn our productsJAX-RPC supported by WAS 5.0.2 6.1 so limited supportWAS 6.0 and above,you can plug in JAX-B and/or custom serializersWeb services feature pack will support JAX-WS and JAX-BWebSphere ESB and WPS have limited support,38,利用Adapters集成现有系统,An ESB must allow access to existing Enterprise Information SystemsAdapters typically used,and may or may not be part of the ESBTechnology 技术适配器Application 应用适配器Legacy 遗留系统适配器适配器与ESB的位置关系:Outside of the ESB,and inside the EIS domainOutside the ESB,and the EIS domainOn the boundary of the ESBInside the ESBAdapters两个关键技术点Communication protocolMessage format,39,2.确定哪个应用程序需要适应总线,Who is responsible for building adapters on to the bus is a governance issue.It is frequently driven by ownership,power,and funding considerations.It may be influenced by the technical considerationsOptions:ESB declares canonical messages and all requestors and providers adapt to the canonical format.ESB adapts all providers(or a limited set)to a canonical format.Requestors adapt to canonical format.ESB adapts requestors(usually legacy requestor)to canonical or provider specific format.ESB adapts directly from a provider format to a specific requestor format(basically point to point).,40,3.仅当需要的时候才用可靠性和事务处理功能,QoS includes not only performance but reliability measures as well Use reliable delivery sparingly Relatively high performance penalty Limited to some transports or standards 少用事务 利用 services 而不是本地调用,41,4.将基本信息放在消息头中，而不是消息体中,Place infrastructure logic such as security,logging levels,client application identify in a header which is separate from the body of a messageESBs are designed to support separation of infrastructure processing from service logic and are frequently optimized to use headers.Its better to use headers which are protocol independent to allow header information to seamlessly flow across the various protocols the bus supports.No header mapping is required as the bus converts to a new protocolIncluded in SOAP is separation of the header from the bodyWhen designing your own message formats,have a header section and a body section,42,5.ESB联邦设计,基本上每个大型ESB项目都会遇到ESB联邦Multiple products used for ESB functionalityMultiple sites dictate multiple product installationsOrganizational,Corporate or political boundaries may dictate the boundary of an ESBESB联邦最佳解决方案是采用gatewayRouting requests to the appropriate ESB(local or remote)Handling special security requirements across boundariesProviding logging and auditing requirements across boundariesDealing with technology differences in transport or format,43,ESB 联邦,WESB,WMB,HTTP BackboneWS-Security,MQ BackboneTransport Security,XI50 Gateway,站点 1,站点2,IBM关于建立东风有限统一的ESB的建议方案,45,IBM ESB简介,标准的企业服务总线：WebSphere ESB高级的企业服务总线：WebSphere Message Broker企业服务总线Gateway：DataPower,46,WebSphere ESB 架构,C+Client,.NetClient,WebSphere ESB,WebSphere Application Server,Tivoli Access Manager,DB2 Universal Database,Edge Components,Java and C/C+Web ServicesClient,Clients:,Messaging:,JMS 1.1,MQ interoperability,Mediation Function,Web Services:,WebSphere Adapter Support,XSLT,MessageRouter,MessageLogger,DBLookup,WS-*,SOAP/HTTP,UDDI Registry 3.0,SOAP/JMS,Lightweight Java Clientcoming,WebSphere IntegrationDeveloper,SCAProgrammingModel:,SDO,SCA,47,WebSphere Application Server,Increased capabilities/automation,Business Process,ESB,A world-class J2EE foundation providing industry-leading levels of availability,scalability,and performance.,WebSphere Process Server,For customers who want a higher level solution to design,automate and manage composite applications and operational business processes.Built on WebSphere ESB.,WebSphere ESB,A new product that delivers an Enterprise Service Bus.Provides Web Services connectivity and data transformation.Built on WebSphere Application Server.,Subset,Superset,WebSphere ESB的位置,48,WebSphere ESB and WebSphere Message Broker,ESB:WebSphere ESB,Advanced ESB:WebSphere Message Broker,Customers face a range of ESB requirements.As a result,any given project might require an ESB or an Advanced ESB OR BOTH.,Web Services connectivityand data transformation,Web Services,JMS,WebSphere MQ,HTTP,XML,WebSphere Adapters,JMS,TIBCO Rendezvous,Web Services,Weblogic JMS,WebSphere MQ,TIBCO EMS JMS,HTTP,SonicMQ JMS,Biztalk,MQe,Tuxedo,Real-time IP,FTP,Multicast,MQTT,XML,COBOLCopybook,EDI-X.12,ACORD,EDI-FACT,ebXML,AL3,HIPAA,HL7,SWIFT,FIX,Custom Formats,Word/Excel/PDF,Plus the following:,WebSphere Adapters,Universal connectivity and data transformation,核心版,高级版,49,SOA 利器 WebSphere DataPower,IBM 和 DataPower 利用专用的耐久性SOA设备 为SOA实施提供优异的性能与硬件安全性 重新定义了中间件的界限，扩大了SOA的基础。,简化 SOA专用的 SOA 设备，部署、管理及维护更加简便，降低成本；保护 SOA集中化管理、丰富的安全策略，更高的可靠性，有力保障系统安全；加速 SOA无与伦比的 XML 处理能力，大幅提高系统处理速度和吞吐量；,50,DataPower 典型应用场景,保护对外的 Web 服务支持合作伙伴、客户安全地访问记录的后端系统传统系统集成把大型机或传统应用连接到 Web 服务SOAHUB 式的中介服务在应用和 Web 服务间有效地转换、路由、记录消息加速动态的 Web 站点加快 XML-HTML 渲染，用于动态内容生成,51,东风汽车有限公司ESB建议方案,企业组ESB部门/应用级ESBESB Gateway,52,企业级ESB典型方案,Enterprise Service Bus（MB）,交互服务,Web页面,内部流程服务,Web页面,DMS,召回系统,SAP,OA,Adapter,SOAP/JMS/IIOP,SOAP/JMS/IIOP,SOAP/JMS/IIOP,